Our use of cookies

We use cookies to tailor your experience, gather analytics, and provide you with live assitance. By clicking "Accept" or continuing to browse our site you agree to the use of cookies. For more details please read our Cookie Policy.

Why use SQList to generate Power BI reports from SharePoint lists, rather than using the Power BI native connector to SharePoint?

The main reason is that in practical terms using the native connector only works for small amount of data and simple queries. When you start using it on lists with many thousands of items and/or want to run queries across many large lists, you soon hit limitations in terms of amount of data you can query and the time it takes to execute them.

When you connect to a data source (e.g. a database, Excel file, or in this case SharePoint lists) from power BI you can choose two way of connecting to it:

  1. Direct query: in this type of connection, Power BI reads the data directly from the source every time you run a report. The advantages of this connection type are a) your report always shows up-to-date data, b) you offload some of the processing to the server providing the data instead of performing all the processing on the machine running Power BI; the only disadvantage is Power BI has to  connect to the data source every time is executes the report that can be affected by slow network connections (not really an issue in a business/corporate environment).
  2. Import: in this case, Power BI first imports all the data from the source into its own database, and then runs the report using that local copy of the data. The advantage of this connection is that, once all data is transferred from the source to the Power BI local database, you do not need to connect to the data source any longer; the disadvantages are a) the transfer of the data can take a long time when you want to report on large data sets, b) you must refresh all data imports every time you want an up-to-date report, c) all data processing is performed by the machine running Power BI which can be intensive in case of complex reports, d) there is a limit to the amount of data you can import (1Gb I think), e) there is a limit to the times you can refresh the data automatically.

AxioWorks SQList continuously export SharePoint lists and libraries as normalised SQL Server tables, making live SharePoint data available to reporting tools like Power BICrystal Reports, or SSRS.

The Power BI built-in connection to SharePoint only allows you to use the “Import” connection type.

Additional advantages of using SQList are:

  • SharePoint data is exported in a normalised form, which is the structure that allows you to execute the most flexible queries and, therefore, reports;
  • SQList can export SharePoint certain data in a format that would require complex configurations and time-consuming processing to obtain using the native connector (e.g. multi-value lookup columns, taxonomy metadata);
  • your SharePoint data is available as SQL Server tables, which gives you the option of overlaying it with SQL views that can greatly enhance access control and performance when generating the reports;
  • you can use “Direct query” connections (in fact, we recommend them) for up-to-date reports that executes very fast as the heavy processing is performed by SQList (which is built for that).
  • configuring SQList can take as little as 5 minutes to have your data available in SQL Server, there is virtually no learning curve and not changes to your environment are necessary;
  • virtually all reporting and BI tools can connect directly to SQL Server tables so all the above is valid for them too (SSR, Crystal Reports, Cognos, Tableau, and so on).

Finally, there are some features that are available in Power BI when using “Import” rather than “Direct query” (this is good summary https://powerbidocs.com/2021/02/21/power-bi-import-vs-direct-query-mode-difference/), but that can be easily replaced by equivalent (and even more powerful) functions in the SQL Server side.

Latest articles

AxioWorks Newsletter November 2021: What has AxioWorks been up to?

03 Dec 2021

Hello Reader, Welcome to another exciting issue of our monthly Newsletter! Each month, we try our best to bring to you content that is relevant and […]
[read article]

What went down in MS Ignite 2021 : Power BI Edition

30 Nov 2021

When we talk about the biggest annual tech conferences of the year, Microsoft Ignite comes to mind where not only we get a view of all their product […]
[read article]

AxioWorks Newsletter October 2021: Focus on customer service and a webinar on its way

01 Nov 2021

Hello Reader, Welcome to another exciting issue of our monthly Newsletter! Each month, we try our best to bring to you content that is relevant and […]
[read article]

Gain valueable Insights into your PowerApps using Application Insights

25 Oct 2021

Power Platform provides a great way for citizen developers to develop Apps using low-code /no-code tools like PowerApps, PowerAutomate, and PowerBI. […]
[read article]

AxioWorks Newsletter September 2021: Focus on our sales effort

18 Oct 2021

Hello Reader, Welcome to another exciting issue of our monthly Newsletter! Each month, we try our best to bring to you content that is relevant and […]
[read article]

Why use SQList to generate Power BI reports from SharePoint lists, rather than using the Power BI native connector to SharePoint?

18 Oct 2021

The main reason is that in practical terms using the native connector only works for small amount of data and simple queries. When you start using it […]
[read article]

SharePoint Online List vs SQL Server as Data Source in Power-BI

15 Sep 2021

Lists are primarily used as a source of data storage in the world of SharePoint and in most scenarios these lists can grow really fast especially if […]
[read article]

AxioWorks Newsletter August 2021: We’re working hard

30 Aug 2021

Hello Reader, Welcome to another exciting issue of our monthly Newsletter! Each month, we try our best to bring to you content that is relevant and […]
[read article]

Get the Power of Location-based analytics in Power BI using ArcGIS Maps

16 Aug 2021

In today’s world, data analytics has to become pivotal for making informed decisions and decision-makers are always keen to find new and innovative […]
[read article]

AxioWorks Newsletter July 2021: We’ve expanded!

01 Aug 2021

Hello Reader, Welcome to another exciting issue of our monthly Newsletter! Each month, we try our best to bring to you content that is relevant and […]
[read article]

Get SharePoint and SQL news to your inbox

Stay up-to-date with industry news and trends, SQL and SharePoint innovations and all the latest from AxioWorks by subscribing to our monthly newsletter.

Subscribe to the AxioWorks newsletter

*