Our use of cookies

We use cookies to tailor your experience, gather analytics, and provide you with live assitance. By clicking "Accept" or continuing to browse our site you agree to the use of cookies. For more details please read our Cookie Policy.

Why use SQList to generate Power BI reports from SharePoint lists, rather than using the Power BI native connector to SharePoint?

The main reason is that in practical terms using the native connector only works for small amount of data and simple queries. When you start using it on lists with many thousands of items and/or want to run queries across many large lists, you soon hit limitations in terms of amount of data you can query and the time it takes to execute them.

When you connect to a data source (e.g. a database, Excel file, or in this case SharePoint lists) from power BI you can choose two way of connecting to it:

  1. Direct query: in this type of connection, Power BI reads the data directly from the source every time you run a report. The advantages of this connection type are a) your report always shows up-to-date data, b) you offload some of the processing to the server providing the data instead of performing all the processing on the machine running Power BI; the only disadvantage is Power BI has to  connect to the data source every time is executes the report that can be affected by slow network connections (not really an issue in a business/corporate environment).
  2. Import: in this case, Power BI first imports all the data from the source into its own database, and then runs the report using that local copy of the data. The advantage of this connection is that, once all data is transferred from the source to the Power BI local database, you do not need to connect to the data source any longer; the disadvantages are a) the transfer of the data can take a long time when you want to report on large data sets, b) you must refresh all data imports every time you want an up-to-date report, c) all data processing is performed by the machine running Power BI which can be intensive in case of complex reports, d) there is a limit to the amount of data you can import (1Gb I think), e) there is a limit to the times you can refresh the data automatically.

AxioWorks SQList continuously export SharePoint lists and libraries as normalised SQL Server tables, making live SharePoint data available to reporting tools like Power BICrystal Reports, or SSRS.

The Power BI built-in connection to SharePoint only allows you to use the “Import” connection type.

Additional advantages of using SQList are:

  • SharePoint data is exported in a normalised form, which is the structure that allows you to execute the most flexible queries and, therefore, reports;
  • SQList can export SharePoint certain data in a format that would require complex configurations and time-consuming processing to obtain using the native connector (e.g. multi-value lookup columns, taxonomy metadata);
  • your SharePoint data is available as SQL Server tables, which gives you the option of overlaying it with SQL views that can greatly enhance access control and performance when generating the reports;
  • you can use “Direct query” connections (in fact, we recommend them) for up-to-date reports that executes very fast as the heavy processing is performed by SQList (which is built for that).
  • configuring SQList can take as little as 5 minutes to have your data available in SQL Server, there is virtually no learning curve and not changes to your environment are necessary;
  • virtually all reporting and BI tools can connect directly to SQL Server tables so all the above is valid for them too (SSR, Crystal Reports, Cognos, Tableau, and so on).

Finally, there are some features that are available in Power BI when using “Import” rather than “Direct query” (this is good summary https://powerbidocs.com/2021/02/21/power-bi-import-vs-direct-query-mode-difference/), but that can be easily replaced by equivalent (and even more powerful) functions in the SQL Server side.

Latest articles

AxioWorks Newsletter September 2023: An exhilarating month.

30 Sep 2023

Hello Reader, September has been a bustling and exhilarating month for us at AxioWorks, filled with advancements, collaborations, and a whole lot of […]
[read article]

The Collaborative Pathway: Bridging Minds in the AI Ecosystem

19 Sep 2023

In recent days, I found myself immersed in an enlightening conversation with a friend, a fellow entrepreneur steering his ship in the vast sea of […]
[read article]

AxioWorks Newsletter August 2023: A month of milestones and innovation.

28 Aug 2023

Hello Reader, September seems to be a month of unexpected milestones and continued innovations at AxioWorks. As the summer wanes and the autumn […]
[read article]

Use Graph API in Power Automate to read large Excel files from SharePoint

28 Aug 2023

Power Automate, a part of Microsoft’s suite of tools, is increasingly becoming a preferred choice for automating workflows and business […]
[read article]

From Punch Cards to Python: Still Hitting the Keys in my 50s

16 Aug 2023

I spent the entire weekend writing code, not because of deadlines to meet or million-pound dreams, but for the kick that I still get from doing it. […]
[read article]

AxioWorks Newsletter July 2023: Unveiling AxioWorks’s latest successes and exciting innovations

27 Jul 2023

Hello Reader, We hope this monthly update finds you in good spirits. As always, we are eager to share the latest developments and exciting ventures […]
[read article]

AI and Data: The Symbiosis of Interaction and Accuracy

13 Jul 2023

Artificial Intelligence (AI) has rapidly emerged as a revolutionary technology that fundamentally alters the nature of human-machine interactions. […]
[read article]

AxioWorks Newsletter June 2023: SQList v8 Release, Webinars, and New Product Development

30 Jun 2023

Hello Reader, Greetings to all our valued customers and subscribers! We are thrilled to share some exciting updates and developments with you in this […]
[read article]

Safeguarding Secrets with Secure Strings and Environment Variables in the Power Platform

26 Jun 2023

In today’s interconnected digital landscape, safeguarding sensitive information and maintaining robust security measures is of paramount […]
[read article]

Case study: Streamlining Medical Trial Data Analysis in the Pharmaceutical industry

15 Jun 2023

In the ever-evolving landscape of the pharmaceutical industry, conducting medical trials and analysing the resulting data are critical for the […]
[read article]

Get SharePoint and SQL news to your inbox

Stay up-to-date with industry news and trends, SQL and SharePoint innovations and all the latest from AxioWorks by subscribing to our monthly newsletter.

Subscribe to the AxioWorks newsletter

*