3 Replies Latest reply: May 15, 2014 10:07 AM by elginreigner _ RSS

    Databases over 1GB

    bdecoulos _

      How do I access data from a ODBC database that is larger than 1GB.  After I start to bring in the data, I receive and error message, "Maximum size is 1 GB".  I only need a small portion of the data, but I can not filter the data until I bring it into Monarch.  Is there any way to filter the data prior to the importing of the data, which I can do with Excel, by creating criterias?

       

      I am operating with Monarch 10.5.

        • Databases over 1GB
          Olly Bond

          Hello bdecoulos,

           

          Yes, you can specify a filter to be applied when opening a database, the filter is saved in the model, along with all the other filters, but the fact that it is applied on opening the database is saved in the project file, IIRC.

           

          To help get started, it might be useful to use Excel to make a small subset (100 records, say), of your data, and to build your model and filter using this. Then save the project with the filter applied. With the project open in Monarch, go to File, Database and change from the Excel to the ODBC source, and it should be OK. Save the project again to remember the new data location.

           

          HTH,

           

          Olly

            • Databases over 1GB
              Data Kruncher

              Doesn't the "Change..." button found on the sample data screen in the Database wizard allow you to define the selection criteria to retrieve from the database to limit the data brought into Monarch? Or is that the mechanism that you're referring to Olly?

               

              It doesn't try to retrieve the entire database first, and then import the only the data satisfying the filter criteria. I believe.

               

              This prevents the entire database from being retrieved, and then having the active Table window filter being applied to that entire selection.

               

              To retrieve the entirety of a large database, you'd need to use multiple projects/models with appropriate filters and one way or another ensure that in the end you've retrieved every record.