Sunday, March 30, 2025

Oracle Analytics, Data Flow, is there a row limit?

 When working with Oracle Analytics we can use "Data Flow". This is end user oriented ELT tool. 

Usually the results are limited to 2 million rows, yet there is a case when the limitation doesn't kick in. This happens when all the sources and the target are in the same Database. In that case the entire process is done in the DB and is not subject to the limitations.

This is documented in Oracle Support: What Are The Data Row Limits and Join Limits For Data Flows in Oracle Analytics? (Doc ID 2789840.1) where this behavior is described as "function ship". 

For example, I will use my NY.Yellow table with over 50 million data rows.



When trying to load the DB table-based dataset into Dataset Storage using dataflow, I see the 2 million rows limit in the data flow log:



[nQSError: 60008] The query exceeded the maximum query governing rows 2000000 from the database ...



When both source and target are in the same DB (and the target is Database Connection), I load successfully all the 50 million rows into a new dataset without issues. 






No comments:

Post a Comment