cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
Geoff_Olives
Advocate I
Advocate I

Data load for Dataverse for Teams tables

Can someone suggest some solutions for loading data into my Dataverse for Teams application? I've setup tables and have hundreds of records to add, but the only method I see is manually typing in the data.

 

Do we have to create some Power Automate to pick up data in a CSV or Excel file and add it to the tables? Or is there some better way?

 

Thanks for your ideas.


Geoff

2 ACCEPTED SOLUTIONS

Accepted Solutions
Geoff_Olives
Advocate I
Advocate I

I had to build a Power Automate flow. 

There is no "upsert" CDS function, so I had to create a flow that looks at an Excel table and cycles through the records, for each row it queries the database to see if the record alread exists. If so, then update. If not, then insert. 

This is so incredibly complicated for a tool that Microsoft is trying to put into the hands of the user! It took a few hours to learn how to put it all together correctly, and changes to the data are a pain. Tell me that any of my users would be able to do this, even with guidance. 

 

Setup your import file:

  1. Create an Excel file in Teams. Save the file in a channel.
  2. Add columns and data
  3. Format as a table
  4. Name the table the name of your table to help keep it straight.

Import data via Excel in Dataverse for Teams:

  1. Open Power Apps in Teams
  2. Click the Build tab.
  3. Select your team and click See all in the Built by this team panel.
  4. Click the Flows page on the left and then click New.
  5. Create a new flow, from manual trigger.
  6. Add a step - Excel: List rows present in a table 
    1. Point the step to the sharepoint site for the team
    2. Point the Document library to the library in the team
    3. Choose the file. I called mine "data load".
    4. Select the table that was named above.
  7. Add a step - Apply to each
    1. Output from this step is the Excel value
  8. Add a step inside the apply to each - CDS List records. Look for an existing record with the filter.
    1. Set the Entity name to the name of the Dataverse table
    2. Show advanced options
    3. Set Filter query to be the key column of the table, equal to, and set to column from your Excel table.  The name of the column in the Dataverse table is not the same as the description. Open the table to see all the columns with the actual column name. My "Name" column was actually named "cre4f_name".  "eq" mean equals. And then surround the Excel field from the previous step with single tick marks.  The result looks like this:
    4. Query:  cre4f_name eq '[xl]Name'
  9. Add a step inside the apply to each - Condition
    1. Set the condition to be an expression.  Check the length of the output to see if a record came back from the query. "List_records" below is the name of the previous step, with the space replaced by an underscore.
    2. Expression:  length(outputs('List_records')?['body/value'])
  1. Add a step to the Yes condition.
    1. Update a record 2
    2. Set Item ID to Previous CDS entity (My table is called Member)
    3. Set the new values for the fields. I updated Email, first name, last name, phone.  
    4. I had to use a formula to setup dates properly. "If the Join date field isn't empty, then set the join date to start of day(join date).
if(equals(empty(items('Apply_to_each')?['Join Date']),bool('True')),null,startOfDay(items('Apply_to_each')?['Join Date']))
 
 
Add another step to the no condition.
Create a new record. Entity is the CDS members.
Set the key.
Update all the fields as above.
 
 
Test. Fix. Repeat until it actually works.
 
1.png2.png3.png4.png5.png

View solution in original post

Hello @Geoff_Olives,

I'm sure you've seen this post already, but just in case anyone lands here, Microsoft have now provided functionality to import/edit data into Dataverse for Teams via Excel.

Here's the blog post.

Here's the Microsoft Docs.

Thanks,

Garry

View solution in original post

12 REPLIES 12
HSheild
Most Valuable Professional
Most Valuable Professional

Hi @Geoff_Olives ,

 

I’m haven’t tried this scenario yet but it looks like you will have to build a Power Automate Flow at this stage based on the documentation.

 

https://docs.microsoft.com/en-us/powerapps/teams/data-platform-faqs#how-do-users-import-data-into-ta...

 

security.

How do users import data into tables in Dataverse for Teams?

Makers have the opportunity to bring in data through both the apps they develop as well as via connectors in Power Apps and Power Automate.

EricRegnier
Most Valuable Professional
Most Valuable Professional

Hi @Geoff_Olives,

Haven't tried this either, but Dataflows might work with the CSV or Excel connector:

https://docs.microsoft.com/en-us/powerapps/maker/common-data-service/create-and-use-dataflows 

 

EDIT: might not be possible after all following this threadhttps://docs.microsoft.com/en-us/powerapps/teams/data-platform-compare#business-intelligence-and-pro...

 

Cheers

Geoff_Olives
Advocate I
Advocate I

I had to build a Power Automate flow. 

There is no "upsert" CDS function, so I had to create a flow that looks at an Excel table and cycles through the records, for each row it queries the database to see if the record alread exists. If so, then update. If not, then insert. 

This is so incredibly complicated for a tool that Microsoft is trying to put into the hands of the user! It took a few hours to learn how to put it all together correctly, and changes to the data are a pain. Tell me that any of my users would be able to do this, even with guidance. 

 

Setup your import file:

  1. Create an Excel file in Teams. Save the file in a channel.
  2. Add columns and data
  3. Format as a table
  4. Name the table the name of your table to help keep it straight.

Import data via Excel in Dataverse for Teams:

  1. Open Power Apps in Teams
  2. Click the Build tab.
  3. Select your team and click See all in the Built by this team panel.
  4. Click the Flows page on the left and then click New.
  5. Create a new flow, from manual trigger.
  6. Add a step - Excel: List rows present in a table 
    1. Point the step to the sharepoint site for the team
    2. Point the Document library to the library in the team
    3. Choose the file. I called mine "data load".
    4. Select the table that was named above.
  7. Add a step - Apply to each
    1. Output from this step is the Excel value
  8. Add a step inside the apply to each - CDS List records. Look for an existing record with the filter.
    1. Set the Entity name to the name of the Dataverse table
    2. Show advanced options
    3. Set Filter query to be the key column of the table, equal to, and set to column from your Excel table.  The name of the column in the Dataverse table is not the same as the description. Open the table to see all the columns with the actual column name. My "Name" column was actually named "cre4f_name".  "eq" mean equals. And then surround the Excel field from the previous step with single tick marks.  The result looks like this:
    4. Query:  cre4f_name eq '[xl]Name'
  9. Add a step inside the apply to each - Condition
    1. Set the condition to be an expression.  Check the length of the output to see if a record came back from the query. "List_records" below is the name of the previous step, with the space replaced by an underscore.
    2. Expression:  length(outputs('List_records')?['body/value'])
  1. Add a step to the Yes condition.
    1. Update a record 2
    2. Set Item ID to Previous CDS entity (My table is called Member)
    3. Set the new values for the fields. I updated Email, first name, last name, phone.  
    4. I had to use a formula to setup dates properly. "If the Join date field isn't empty, then set the join date to start of day(join date).
if(equals(empty(items('Apply_to_each')?['Join Date']),bool('True')),null,startOfDay(items('Apply_to_each')?['Join Date']))
 
 
Add another step to the no condition.
Create a new record. Entity is the CDS members.
Set the key.
Update all the fields as above.
 
 
Test. Fix. Repeat until it actually works.
 
1.png2.png3.png4.png5.png
EricRegnier
Most Valuable Professional
Most Valuable Professional

Yep, there might be a learning curve at first but from a developer/citizen developer perspective promise that you'll get the hang of it quickly. Also, note the Dataverse for Teams just came come out so we should expect a lot of features and enhancements in the next waves...

Unfortunately there isn't an upsert function with the connector but there's is with the SDK.

You should submit that idea at (if it doesn't already exists): https://powerusers.microsoft.com/t5/Power-Apps-Ideas/idb-p/PowerAppsIdeas

Cheers

Hello @Geoff_Olives,

I'm sure you've seen this post already, but just in case anyone lands here, Microsoft have now provided functionality to import/edit data into Dataverse for Teams via Excel.

Here's the blog post.

Here's the Microsoft Docs.

Thanks,

Garry

I had not, but this will be awesome. I'll have to check it out.

 

@GarryPope The information in the

 

Use “Edit in Excel” in Dataverse for Teams

 

link seems incorrect. It says:

 

 

  • From the Build tab select Tables, and then select your table.
  • Expand the ellipses menu to access the “Edit in Excel” feature.

I don't have an ellipsis menu.

 

 

Anonymous
Not applicable

Hi Everyone,

 

The Power Automate approach above looks like a great solution. However, one of the reasons we are using Dataverse in Teams is to avoid the premium costs of connecting to our onsite data, etc. and this Power Automate uses a couple of Premium Actions.

I have also tested the "Edit in Excel" in Dataverse for Teams and it works great, but it is a very manual process. I will need to update my 5 data tables 2-3 times per day so doing this manually will get tedious. Has anyone found another automated solution or built one with Power Automate?  I am still learning Power Automate, so not sure what it's full potential is without using Premium Actions.

Thanks for any advice!

Anonymous
Not applicable


@AlanBourke wrote:

@GarryPopeThe information in the

 

Use “Edit in Excel” in Dataverse for Teams

 

link seems incorrect. It says:

 

 

  • From the Build tab select Tables, and then select your table.
  • Expand the ellipses menu to access the “Edit in Excel” feature.

I don't have an ellipsis menu.

 

 


Hi Alan,

After installing the MS Office PowerApps add-in, it took me a bit to find the ellipsis menu with the appropriate "Edit data in Excel" option within Teams. I discovered that you have to click the Build tab, then click the See All link. The "Edit data in Excel" option will not be on those menus even though your tables may be listed there.  You still have to click the Tables tab on the left panel and only then can you select the ellipsis menu and get the "Edit data in Excel" option.

Hope it helps!

Helpful resources

Announcements

Tuesday Tip | Update Your Community Profile Today!

It's time for another TUESDAY TIPS, your weekly connection with the most insightful tips and tricks that empower both newcomers and veterans in the Power Platform Community! Every Tuesday, we bring you a curated selection of the finest advice, distilled from the resources and tools in the Community. Whether you’re a seasoned member or just getting started, Tuesday Tips are the perfect compass guiding you across the dynamic landscape of the Power Platform Community.   We're excited to announce that updating your community profile has never been easier! Keeping your profile up to date is essential for staying connected and engaged with the community.   Check out the following Support Articles with these topics: Accessing Your Community ProfileRetrieving Your Profile URLUpdating Your Community Profile Time ZoneChanging Your Community Profile Picture (Avatar)Setting Your Date Display Preferences Click on your community link for more information: Power Apps, Power Automate, Power Pages, Copilot Studio   Thank you for being an active part of our community. Your contributions make a difference! Best Regards, The Community Management Team

Hear what's next for the Power Up Program

Hear from Principal Program Manager, Dimpi Gandhi, to discover the latest enhancements to the Microsoft #PowerUpProgram, including a new accelerated video-based curriculum crafted with the expertise of Microsoft MVPs, Rory Neary and Charlie Phipps-Bennett. If you’d like to hear what’s coming next, click the link below to sign up today! https://aka.ms/PowerUp  

Tuesday Tip: Community User Groups

It's time for another TUESDAY TIPS, your weekly connection with the most insightful tips and tricks that empower both newcomers and veterans in the Power Platform Community! Every Tuesday, we bring you a curated selection of the finest advice, distilled from the resources and tools in the Community. Whether you’re a seasoned member or just getting started, Tuesday Tips are the perfect compass guiding you across the dynamic landscape of the Power Platform Community.   As our community family expands each week, we revisit our essential tools, tips, and tricks to ensure you’re well-versed in the community’s pulse. Keep an eye on the News & Announcements for your weekly Tuesday Tips—you never know what you may learn!   Today's Tip: Community User Groups and YOU Being part of, starting, or leading a User Group can have many great benefits for our community members who want to learn, share, and connect with others who are interested in the Microsoft Power Platform and the low-code revolution.   When you are part of a User Group, you discover amazing connections, learn incredible things, and build your skills. Some User Groups work in the virtual space, but many meet in physical locations, meaning you have several options when it comes to building community with people who are learning and growing together!   Some of the benefits of our Community User Groups are: Network with like-minded peers and product experts, and get in front of potential employers and clients.Learn from industry experts and influencers and make your own solutions more successful.Access exclusive community space, resources, tools, and support from Microsoft.Collaborate on projects, share best practices, and empower each other. These are just a few of the reasons why our community members love their User Groups. Don't wait. Get involved with (or maybe even start) a User Group today--just follow the tips below to get started.For current or new User Group leaders, all the information you need is here: User Group Leader Get Started GuideOnce you've kicked off your User Group, find the resources you need:  Community User Group ExperienceHave questions about our Community User Groups? Let us know! We are here to help you!

Super User of the Month | Ahmed Salih

We're thrilled to announce that Ahmed Salih is our Super User of the Month for April 2024. Ahmed has been one of our most active Super Users this year--in fact, he kicked off the year in our Community with this great video reminder of why being a Super User has been so important to him!   Ahmed is the Senior Power Platform Architect at Saint Jude's Children's Research Hospital in Memphis. He's been a Super User for two seasons and is also a Microsoft MVP! He's celebrating his 3rd year being active in the Community--and he's received more than 500 kudos while authoring nearly 300 solutions. Ahmed's contributions to the Super User in Training program has been invaluable, with his most recent session with SUIT highlighting an incredible amount of best practices and tips that have helped him achieve his success.   Ahmed's infectious enthusiasm and boundless energy are a key reason why so many Community members appreciate how he brings his personality--and expertise--to every interaction. With all the solutions he provides, his willingness to help the Community learn more about Power Platform, and his sheer joy in life, we are pleased to celebrate Ahmed and all his contributions! You can find him in the Community and on LinkedIn. Congratulations, Ahmed--thank you for being a SUPER user!  

Tuesday Tip: Getting Started with Private Messages & Macros

Welcome to TUESDAY TIPS, your weekly connection with the most insightful tips and tricks that empower both newcomers and veterans in the Power Platform Community! Every Tuesday, we bring you a curated selection of the finest advice, distilled from the resources and tools in the Community. Whether you’re a seasoned member or just getting started, Tuesday Tips are the perfect compass guiding you across the dynamic landscape of the Power Platform Community.   As our community family expands each week, we revisit our essential tools, tips, and tricks to ensure you’re well-versed in the community’s pulse. Keep an eye on the News & Announcements for your weekly Tuesday Tips—you never know what you may learn!   This Week's Tip: Private Messaging & Macros in Power Apps Community   Do you want to enhance your communication in the Community and streamline your interactions? One of the best ways to do this is to ensure you are using Private Messaging--and the ever-handy macros that are available to you as a Community member!   Our Knowledge Base article about private messaging and macros is the best place to find out more. Check it out today and discover some key tips and tricks when it comes to messages and macros:   Private Messaging: Learn how to enable private messages in your community profile and ensure you’re connected with other community membersMacros Explained: Discover the convenience of macros—prewritten text snippets that save time when posting in forums or sending private messagesCreating Macros: Follow simple steps to create your own macros for efficient communication within the Power Apps CommunityUsage Guide: Understand how to apply macros in posts and private messages, enhancing your interaction with the Community For detailed instructions and more information, visit the full page in your community today:Power Apps: Enabling Private Messaging & How to Use Macros (Power Apps)Power Automate: Enabling Private Messaging & How to Use Macros (Power Automate)  Copilot Studio: Enabling Private Messaging &How to Use Macros (Copilot Studio) Power Pages: Enabling Private Messaging & How to Use Macros (Power Pages)

April 4th Copilot Studio Coffee Chat | Recording Now Available

Did you miss the Copilot Studio Coffee Chat on April 4th? This exciting and informative session with Dewain Robinson and Gary Pretty is now available to watch in our Community Galleries!   This AMA discussed how Copilot Studio is using the conversational AI-powered technology to aid and assist in the building of chatbots. Dewain is a Principal Program Manager with Copilot Studio. Gary is a Principal Program Manager with Copilot Studio and Conversational AI. Both of them had great insights to share with the community and answered some very interesting questions!     As part of our ongoing Coffee Chat AMA series, this engaging session gives the Community the unique opportunity to learn more about the latest Power Platform Copilot plans, where we’ll focus, and gain insight into upcoming features. We’re looking forward to hearing from the community at the next AMA, so hang on to your questions!   Watch the recording in the Gallery today: April 4th Copilot Studio Coffee Chat AMA

Users online (4,661)