Our use of cookies

We use cookies to tailor your experience, gather analytics, and provide you with live assitance. By clicking "Accept" or continuing to browse our site you agree to the use of cookies. For more details please read our Cookie Policy.

Why use SQList to generate Power BI reports from SharePoint lists, rather than using the Power BI native connector to SharePoint?

The main reason is that in practical terms using the native connector only works for small amount of data and simple queries. When you start using it on lists with many thousands of items and/or want to run queries across many large lists, you soon hit limitations in terms of amount of data you can query and the time it takes to execute them.

When you connect to a data source (e.g. a database, Excel file, or in this case SharePoint lists) from power BI you can choose two way of connecting to it:

  1. Direct query: in this type of connection, Power BI reads the data directly from the source every time you run a report. The advantages of this connection type are a) your report always shows up-to-date data, b) you offload some of the processing to the server providing the data instead of performing all the processing on the machine running Power BI; the only disadvantage is Power BI has to  connect to the data source every time is executes the report that can be affected by slow network connections (not really an issue in a business/corporate environment).
  2. Import: in this case, Power BI first imports all the data from the source into its own database, and then runs the report using that local copy of the data. The advantage of this connection is that, once all data is transferred from the source to the Power BI local database, you do not need to connect to the data source any longer; the disadvantages are a) the transfer of the data can take a long time when you want to report on large data sets, b) you must refresh all data imports every time you want an up-to-date report, c) all data processing is performed by the machine running Power BI which can be intensive in case of complex reports, d) there is a limit to the amount of data you can import (1Gb I think), e) there is a limit to the times you can refresh the data automatically.

AxioWorks SQList continuously export SharePoint lists and libraries as normalised SQL Server tables, making live SharePoint data available to reporting tools like Power BICrystal Reports, or SSRS.

The Power BI built-in connection to SharePoint only allows you to use the “Import” connection type.

Additional advantages of using SQList are:

  • SharePoint data is exported in a normalised form, which is the structure that allows you to execute the most flexible queries and, therefore, reports;
  • SQList can export SharePoint certain data in a format that would require complex configurations and time-consuming processing to obtain using the native connector (e.g. multi-value lookup columns, taxonomy metadata);
  • your SharePoint data is available as SQL Server tables, which gives you the option of overlaying it with SQL views that can greatly enhance access control and performance when generating the reports;
  • you can use “Direct query” connections (in fact, we recommend them) for up-to-date reports that executes very fast as the heavy processing is performed by SQList (which is built for that).
  • configuring SQList can take as little as 5 minutes to have your data available in SQL Server, there is virtually no learning curve and not changes to your environment are necessary;
  • virtually all reporting and BI tools can connect directly to SQL Server tables so all the above is valid for them too (SSR, Crystal Reports, Cognos, Tableau, and so on).

Finally, there are some features that are available in Power BI when using “Import” rather than “Direct query” (this is good summary https://powerbidocs.com/2021/02/21/power-bi-import-vs-direct-query-mode-difference/), but that can be easily replaced by equivalent (and even more powerful) functions in the SQL Server side.

Latest articles

AxioWorks Newsletter November 2023: ESPC23, new partnership, and SQList update!

30 Nov 2023

Hello Reader, Welcome to this month’s edition of the AxioWorks newsletter! We’re thrilled to bring you updates on our recent […]
[read article]

Why Support Legacy SharePoint Versions Like SharePoint 2010?

16 Nov 2023

In the fast-paced world of technology, where new versions and updates are continuously rolled out, a recurring question often arises: “Why […]
[read article]

Why Companies are choosing SQList over Power Automate

30 Oct 2023

In the realm of synchronisation services, AxioWorks’ SQList and Microsoft’s Power Automate (earlier known as PowerApps) have emerged as […]
[read article]

AxioWorks Newsletter October 2023: An exhilarating month.

28 Oct 2023

Hello Reader, As we step into the season of autumn, we are thrilled to share with you the latest developments and opportunities unfolding at […]
[read article]

Why Choose SQList for SharePoint Data Extraction Over DIY Solutions

16 Oct 2023

In the ever-evolving world of technology and data management, the question often arises: “Why should I use a product like #SQList when I can […]
[read article]

AxioWorks Newsletter September 2023: An exhilarating month.

30 Sep 2023

Hello Reader, September has been a bustling and exhilarating month for us at AxioWorks, filled with advancements, collaborations, and a whole lot of […]
[read article]

The Collaborative Pathway: Bridging Minds in the AI Ecosystem

19 Sep 2023

In recent days, I found myself immersed in an enlightening conversation with a friend, a fellow entrepreneur steering his ship in the vast sea of […]
[read article]

AxioWorks Newsletter August 2023: A month of milestones and innovation.

28 Aug 2023

Hello Reader, September seems to be a month of unexpected milestones and continued innovations at AxioWorks. As the summer wanes and the autumn […]
[read article]

Use Graph API in Power Automate to read large Excel files from SharePoint

28 Aug 2023

Power Automate, a part of Microsoft’s suite of tools, is increasingly becoming a preferred choice for automating workflows and business […]
[read article]

From Punch Cards to Python: Still Hitting the Keys in my 50s

16 Aug 2023

I spent the entire weekend writing code, not because of deadlines to meet or million-pound dreams, but for the kick that I still get from doing it. […]
[read article]

Get SharePoint and SQL news to your inbox

Stay up-to-date with industry news and trends, SQL and SharePoint innovations and all the latest from AxioWorks by subscribing to our monthly newsletter.

Subscribe to the AxioWorks newsletter