Jump to content

did any tried to merge rows in powerbi with more than 20k records.


kevinUsa

Recommended Posts

I wanted to merge 1&2 rows in powerbi

i cannot transpose them as they have more than 20k  records. powerbi supports only 18k columns 

Link to comment
Share on other sites

try chatGPT…

 

To merge rows in Power BI with more than 20,000 records, you would typically use the 'Merge Queries' option. However, depending on the complexity of your data and operations, Power BI may have performance issues when handling a large number of records. 

Here are the steps to merge rows:

1. In 'Query Editor', select the primary table you want to merge.
2. Go to the 'Home' tab and select 'Merge Queries'.
3. In the new window, select the secondary table you want to merge with your primary table.
4. Choose the columns you want to merge on in both tables.
5. Choose the type of join you want to perform.
6. Click 'OK'.

However, if you encounter performance issues, you might want to consider:

1. Reducing the data you're merging: If possible, filter out unnecessary data before merging.
2. Splitting the operation: Consider breaking the merge operation into smaller parts, process each one individually, and then append the results.
3. Moving to a more powerful platform: If your data operations are consistently reaching the limitations of Power BI, consider moving to a more robust platform like SQL Server or Azure Data Factory for data preprocessing.

Always remember, though, that as data size and complexity increase, it's important to have a solid data management and processing strategy to ensure optimal performance.

Link to comment
Share on other sites

3 minutes ago, dasari4kntr said:

try chatGPT…

 

To merge rows in Power BI with more than 20,000 records, you would typically use the 'Merge Queries' option. However, depending on the complexity of your data and operations, Power BI may have performance issues when handling a large number of records. 

Here are the steps to merge rows:

1. In 'Query Editor', select the primary table you want to merge.
2. Go to the 'Home' tab and select 'Merge Queries'.
3. In the new window, select the secondary table you want to merge with your primary table.
4. Choose the columns you want to merge on in both tables.
5. Choose the type of join you want to perform.
6. Click 'OK'.

However, if you encounter performance issues, you might want to consider:

1. Reducing the data you're merging: If possible, filter out unnecessary data before merging.
2. Splitting the operation: Consider breaking the merge operation into smaller parts, process each one individually, and then append the results.
3. Moving to a more powerful platform: If your data operations are consistently reaching the limitations of Power BI, consider moving to a more robust platform like SQL Server or Azure Data Factory for data preprocessing.

Always remember, though, that as data size and complexity increase, it's important to have a solid data management and processing strategy to ensure optimal performance.

sample query unte ikkada veyi 

  luckily  had  a table with less than 20k rows but if in case tomorrow   i may need it as there are bunch of  sheets we are  trying to get them into powebi and publish 

Link to comment
Share on other sites

11 minutes ago, kevinUsa said:

sample query unte ikkada veyi 

  luckily  had  a table with less than 20k rows but if in case tomorrow   i may need it as there are bunch of  sheets we are  trying to get them into powebi and publish 

 

As of my knowledge cut-off in September 2021, Power BI doesn't directly support SQL-like queries. Instead, it uses a functional language called Power Query M to shape data, and DAX (Data Analysis Expressions) for calculations and data analysis.

However, in Power Query (the "Query Editor" in Power BI), you can use the GUI to perform operations like merging rows. I will illustrate a generic example below of merging two tables. 

1. Let's assume you have two tables, `Table1` and `Table2`.
2. Click 'Edit Queries' on the Home ribbon to open the Power Query Editor.
3. In the 'Queries' pane on the left, click on `Table1` to select it.
4. On the Home tab, click 'Merge Queries'.
5. In the 'Merge Queries' dialog box, select `Table2` from the dropdown.
6. Click on the key column in `Table1` and then click on the corresponding key column in `Table2`. Both columns should be highlighted.
7. In the 'Join Kind' dropdown, select the type of join you want (for example, 'Inner').
8. Click 'OK'.

If you wish to perform this operation using Power Query M language, it might look like this:

```powerquery
let
    Source = Table.NestedJoin(Table1,{"KeyColumn"},Table2,{"KeyColumn"},"NewColumn",JoinKind.Inner)
in
    Source
```

This M code merges `Table1` and `Table2` on `KeyColumn` using an inner join, and adds the merged rows from `Table2` as a new column `NewColumn` in the resulting table.

However, the code can differ based on your specific needs and the structure of your tables. Always ensure you're handling your data correctly when performing such operations.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...