Modeling Sensor Data and the Limit of 1600 columns

What's your suggestion on the schema required for storing Sensor data? Say we have 5000 sensors, and all of them send data each 5 minutes. One approach is simply store data in a table with time_id, sensor_id and sensor_value columns. However, some queries such as those required for correlation analysis gets challenging. The desired structure for such queries is to have one column in the table per sensor, but then we have the limit of 1600 columns.

 

Thanks!

Comments

  • Depending on how you load your data and whether your sensor array is sparse or not, this might be a use case for Flex.

     

    - Derrick

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file