2 Replies Latest reply: May 15, 2014 10:10 AM by elginreigner _ RSS

    File Format vs Speed

    elginreigner _

      Odd question came up today in a discussion about processing time. A simpe file 50k records, 20 columns. Does anyone know how much difference it takes to process a file like this in a CSV format versus a XLSX format?

        • File Format vs Speed
          Olly Bond

          Hello Elgin

           

          I think there's a registry setting called something like MonarchTraceLogFolder which specifies the path where Monarch writes out a log file. This lets you record the comparative times to the millisecond. The usual disclaimers apply - hard drive speed, other applications running etc. I'm not in front of Monarch now but should be able to check the setting next week.

           

          Hope this helps,

           

          Olly

            • File Format vs Speed
              elginreigner _

              Olly

               

              I'll have to run some tests. I do that the location of the logfile in the registry in an email from Datawatch somewhere. I'm thinking it will be faster as in CSV as the XLSX format requires it to be opened and read/formatted to raw data (MS Access file).