GUIDE: MERGE & DOWNSAMPLE YOUR CAN BUS DATA
CANvas provides a number of great options for customizing your conversion.
Click ‘Options’ in the ‘Output’ tab to specify basic things like save path or real-time clock output format.
But there are far more powerful options available as well:
1# CAN BUS LOG FILE MERGING
In the Options, you can enable Log File Merging.
This is a really cool feature:
Imagine you set up your logger to split files in 100 MB chunks - and that you log data from e.g. 10 trucks.
Over a month, this can lead to tons of individual log files!
How do you manage this?
With CANvas, you just load all your log files and enable Log File Merging to compile it all into one big output file.
To distinguish e.g. LoggerIDs (i.e. what data from what truck), simply include the ID as an output column via the options.
With e.g. Excel pivots it’s then easy to filter your data for fast analysis!
But what if this creates a massive file that is way too heavy for e.g. Excel?
In that case, just enable ‘Dynamic File Splitting’. This allows you to specify a max #rows in the final output file, automatically breaking the merged file into chunks sized as you see fit.
E.g. if you want to limit a file to a max of 20,000 rows, simply enter this in the 'Rows limit' - and your merged "mega file" will be output in blocks of 20,000 rows each.
2# CAN BUS LOG FILE DOWNSAMPLING
Downsampling is another great feature:
For some analyses you need the high frequency - but for others you just want to look at e.g. a daily or hourly trend perspective.
Example: Imagine you’ve set up your CANLogger3000 to store high frequency data from a tractor over several months and you've now got 16 GB of data.
For your analysis you may just need the long-term trend data - and 16 GB of high frequency data can be impractical.
By enabling Downsampling in your data conversion, you can aggregate your CAN data to a specified frequency (in miliseconds).
This lets you turn super frequent data into one observation per Signal per interval (e.g. 1 observation per hour per Signal).
But wait, there’s more!
The average may not be enough for your analysis.
Maybe you also need the standard deviation, min, max or observation count per interval.
No problem - you can just add this information as separate columns in your output file!
Together, Log File Merging and Downsampling provide a powerful combination:
They allow you in a few clicks to go from tons of log files and data - to a single, optimized output file with just the data you need.
Sliced and diced, ready to provide you with insight!
For both Log File Merging and Downsampling, you can save your option settings and load them next time you work.
Further, you can also use Log File Merging if you use CANvas to re-transform your raw CANLoggerX000 data files into e.g. Vector's CANalyzer or PEAK's PCAN-View formats.
We hope you like these great options in CANvas - if you've got ideas for new features, please let us know!
To learn more about the CANLoggerX000 series, click here.