10 Replies Latest reply: Aug 3, 2015 4:29 AM by Theo Klemming RSS

    Line Graph - from simple two Excel columns

    FABIO PETRINI

      I am beginning with Datawatch. I can not create a simple Line Graph from a spreadsheet Excel. I have two columns in Excel spreadsheet (time and value) but Datawatch I can not set the X-axis (time) correctly.

      What should I consider? I noticed that if I set "Already Pivot" the graph is displayed.

       

      Thanks

        • Re: Line Graph - from simple two Excel columns
          Theo Klemming

          Hi Fabio

           

          Let me start with a bit of background: In Datawatch visual data discovery, there is a special treatment of time series data. This makes Datawatch different from many other visual data discovery products. The functionality was developed to meet the requirements set by our clients in capital markets and financial services, where they need to visualize and analyse prices and rates over time.

           

          The first thing you should do is verify that your time value column is correctly understood by Datawatch Designer to be a date-time column. You will see the clock-symbol for that column if yes, otherwise it will be the Abs-symbol (for text) or the hash-sign (for numeric).

           

          Provided the column is understood to be a date-time column, your next step is to Transform the dataset for Timeseries. You do this by pressing the "Transforms" button to the right in the data preview window. In the dialog window that opens, check the box in the middle of the window that says "Transform to enable time series analysis".

           

          Following this, your numeric column (with the values) will get  a red wave as a symbol instead of a red hash sign.

           

          At this point, you will be able to apply your value column to any of the time series visualizations.

          If you apply the values to any of the regular visualizations, those visualizations will show one single time point.

          if you also add your value column to a Time Filter Box, where in the Settings of it you enable "Show Play/Pause Button", you will be able to play through the values.

           

          Putting the Datawatch system parameter {Snapshot} as the visualization title will let you see the current time value when you are in Presentation mode.

           

          Best regards, Theo Klemming, Datawatch

            • Re: Line Graph - from simple two Excel columns
              FABIO PETRINI

              Hi,

              thanks very good assistance!

               

              Step 2 : in my next Excel spreadsheet i have 4 columns.

               

              First Column : Date

              Second Column : Hours and seconds

              Third Colums: Value 1 (volt)

              Fourth Colums: Value 2 (Ampere)

               

              I want to create a data time value (according with Datawatch) concatenating

              the columns Date and Hours and after use a Graph Line to have a timeseries

              graph with two variables ( Value 1 and Value 2) with two color like in the

              image below.

               

               

              Thanks

               

               

               

               

               

              FABIO PETRINI

              *Chief Engineer  *

               

               

               

              M. +39 342.6986081

              T. +39 06.90287150

              E. fabio@ekogreenpower.it

              W. ekogreenpower.it <http://www.ekogreenpower.it>

               

               

              2015-07-27 10:41 GMT+02:00 Theo Klemming <

              datawatch-admin@community.datawatch.com>:

               

                    Datawatch Community

              <https://community.datawatch.com/?et=watches.email.thread>     Line Graph

              - from simple two Excel columns

               

              reply from Theo Klemming

              <https://community.datawatch.com/people/theo?et=watches.email.thread> in *Datawatch

              Designer* - View the full discussion

              <https://community.datawatch.com/message/21354?et=watches.email.thread#21354>

               

                • Re: Line Graph - from simple two Excel columns
                  Theo Klemming

                  Hi

                   

                  I created another video to show how to do what you describe:

                   

                  Timeseries visualization - Merge Date and Time column

                   

                  Best regards, Theo Klemming, Datawatch

                    • Re: Line Graph - from simple two Excel columns
                      FABIO PETRINI

                      Hi,

                       

                      thanks to the excellent work of assistance. I understand these steps.

                      This from you allow me an exponential learning about the system Datawatch.

                       

                      Now I ask you one last step to realize a real-time display:

                      Can you explain in broad terms, as you proceed, if the data that we

                      analyzed in the previous session, are transmitted by measurement devices

                      and registered in databases, text files to a server. How can I make a

                      simple  Real-Time dashboard.?

                       

                      Thanks

                       

                      Thanks.

                       

                      "I decided to buy the Datawatch"

                       

                      FABIO PETRINI

                      *Chief Engineer  *

                       

                       

                       

                      M. +39 342.6986081

                      T. +39 06.90287150

                      E. fabio@ekogreenpower.it

                      W. ekogreenpower.it <http://www.ekogreenpower.it>

                       

                       

                      2015-07-28 14:16 GMT+02:00 Theo Klemming <

                      datawatch-admin@community.datawatch.com>:

                       

                            Datawatch Community

                      <https://community.datawatch.com/?et=watches.email.thread>     Line Graph

                      - from simple two Excel columns

                       

                      reply from Theo Klemming

                      <https://community.datawatch.com/people/theo?et=watches.email.thread> in *Datawatch

                      Designer* - View the full discussion

                      <https://community.datawatch.com/message/21357?et=watches.email.thread#21357>

                       

                        • Re: Line Graph - from simple two Excel columns
                          Theo Klemming

                          Hi

                           

                          The recommended approach for a real-time display depends on two things:

                          A) How you are able to hand off or deliver the data from where it is produced.

                          B) The update frequency of your data - how often are new value collected or registered - and how often do you need to see an update in your dashboard.

                           

                          Here are three different possible scenarios:

                           

                          1. Your data values are collected or registered just a few times per minute. In this case, you could write your new values to a simple flat-file, and build a dashboard that loads that flat-file. If the flat-file is updated say every 15 seconds, you would then set an update rate of 15 seconds on your Datawatch Designer data table.

                           

                          2. Your data values are collected or registered one time per 10-5 seconds. In this case, you could write your new values to a fast database, and build a dashboard that loads data from that database. You would then set an update rate of 5-10 seconds on your Datawatch Designer data table, where your database will be queried as often.

                           

                          3. Your data values update more often than every 5 seconds. In this case, you will need to hand off your data to some software product that provides a streaming output, for which there is a connector in Datawatch. This means either a CEP system (Complex Event Processing) or some Message Middleware product, for example Apache ActiveMQ which is open source. With that kind of middleware as the receiver of new data values, and the provider of data for your Datawatch dashboard, you can work with updates several times per second when viewing in Datawatch Designer, and down to 1 update per second when using the Web Client and Datawatch server.

                           

                          Best regards, Theo Klemming, Datawatch

                            • Re: Line Graph - from simple two Excel columns
                              FABIO PETRINI

                              Hi,

                               

                              The correct scenario is the n.2:

                               

                              Can you show to me how Watchdog read the data from simple database and update the value in real time streaming?

                               

                               

                              Regards.

                               

                               

                              Fabio PETRINI

                              Eko Green Power

                               

                               

                              Il giorno 29/lug/2015, alle ore 13:50, Theo Klemming <datawatch-admin@community.datawatch.com> ha scritto:

                               

                               

                              Datawatch Community

                               

                              Line Graph - from simple two Excel columns

                              reply from Theo Klemming in Datawatch Designer - View the full discussion

                               

                              Hi

                               

                               

                               

                              The recommended approach for a real-time display depends on two things:

                               

                              A) How you are able to hand off or deliver the data from where it is produced.

                               

                              B) The update frequency of your data - how often are new value collected or registered - and how often do you need to see an update in your dashboard.

                               

                               

                               

                              Here are three different possible scenarios:

                               

                               

                               

                              1. Your data values are collected or registered just a few times per minute. In this case, you could write your new values to a simple flat-file, and build a dashboard that loads that flat-file. If the flat-file is updated say every 15 seconds, you would then set an update rate of 15 seconds on your Datawatch Designer data table.

                               

                               

                               

                              2. Your data values are collected or registered one time per 10-5 seconds. In this case, you could write your new values to a fast database, and build a dashboard that loads data from that database. You would then set an update rate of 5-10 seconds on your Datawatch Designer data table, where your database will be queried as often.

                               

                               

                               

                              3. Your data values update more often than every 5 seconds. In this case, you will need to hand off your data to some software product that provides a streaming output, for which there is a connector in Datawatch. This means either a CEP system (Complex Event Processing) or some Message Middleware product, for example Apache ActiveMQ which is open source. With that kind of middleware as the receiver of new data values, and the provider of data for your Datawatch dashboard, you can work with updates several times per second when viewing in Datawatch Designer, and down to 1 update per second when using the Web Client and Datawatch server.

                               

                               

                               

                              Best regards, Theo Klemming, Datawatch

                               

                              Reply to this message by replying to this email, or go to the message on Datawatch Community

                              Start a new discussion in Datawatch Designer by email or at Datawatch Community

                              Following Line Graph - from simple two Excel columns in these streams: Inbox

                               

                                • Re: Line Graph - from simple two Excel columns
                                  Theo Klemming

                                  Hi

                                   

                                  Can you explain more about Watchdog?

                                  Note also that when your data is read from a database, it will be an automated, regular, request-response type of connection. Only when using a streaming data source, that supports subscription based connection, will there be a streaming connection.

                                   

                                  Best regards, Theo Klemming, Datawatch

                                    • Re: Line Graph - from simple two Excel columns
                                      FABIO PETRINI

                                      Sorry, not Watchdog but Datawatch.

                                       

                                       

                                       

                                       

                                      Fabio PETRINI

                                      Eko Green Power

                                       

                                       

                                      Il giorno 29/lug/2015, alle ore 14:22, Theo Klemming <datawatch-admin@community.datawatch.com> ha scritto:

                                       

                                       

                                      Datawatch Community

                                       

                                      Line Graph - from simple two Excel columns

                                      reply from Theo Klemming in Datawatch Designer - View the full discussion

                                       

                                      Hi

                                       

                                       

                                       

                                      Can you explain more about Watchdog?

                                       

                                      Note also that when your data is read from a database, it will be an automated, regular, request-response type of connection. Only when using a streaming data source, that supports subscription based connection, will there be a streaming connection.

                                       

                                       

                                       

                                      Best regards, Theo Klemming, Datawatch

                                       

                                      Reply to this message by replying to this email, or go to the message on Datawatch Community

                                      Start a new discussion in Datawatch Designer by email or at Datawatch Community

                                      Following Line Graph - from simple two Excel columns in these streams: Inbox

                                       

                                        • Re: Line Graph - from simple two Excel columns
                                          Theo Klemming

                                          Hi

                                           

                                          In the evaluation version of Datawatch Designer, the database connectors are not enabled. However, with a full license, these connectors will be activated.

                                           

                                          I will try to produce a demonstration video showing how a dashboard is making regular and frequent requests from a database, and where that database is getting new data appended to it on a regular and frequent basis.

                                           

                                          In the mean time, you are welcome to look at my tutorial videos about the Stream Simulator, which can be helpful for better understanding how to work with streaming data sources in Datawatch.

                                           

                                          Best regards, Theo Klemmming, Datawatch

                          • Re: Line Graph - from simple two Excel columns
                            Theo Klemming

                            Hi again

                             

                            I created a video which I hope will also be helpful:

                            Timeseries visualization introduction

                             

                            Best regards, Theo Klemming, Datawatch