Grafana Azure + BigQuery Integrations for CANedge [News]
news / 2024-06
Grafana-Synapse (Azure) and Grafana-BigQuery (Google Cloud) bring our Grafana dashboard integration for CANedge users to all top 3 clouds, querying DBC decoded Parquet data lakes via serverless SQL. Plus: Nissan and VDL case studies on remote prototype vehicle diagnostics.
Set up Grafana dashboards across Amazon, Google and Azure
The CANedge2/CANedge3 lets you upload CAN/LIN data to your own server - incl. Amazon, Google Cloud and Azure.
In 2023 we launched our Grafana-Athena dashboard integration, enabling Amazon users to visualize data from Parquet data lakes stored in S3. The integration reduces costs by 95%+ vs. 'database based' dashboards - making this a popular deployment!
Now we introduce equivalent setups for our users in Google Cloud and Azure:
In Google Cloud, you can now deploy Grafana-BigQuery. When a log file is uploaded to your input bucket, a Google Cloud Function DBC decodes it to Parquet files - and writes these to an output bucket. The resulting Parquet data lake can be queried via serverless SQL using Google BigQuery. This enables direct integration with Grafana dashboards - but also other tools like Python, MATLAB, Excel and more.
Similarly, in Azure you can deploy Grafana-Synapse. This does the same thing as above, but uses Azure Functions for automation and Azure Synapse to perform the serverless SQL queries. Integration with Grafana is achieved via Grafana's built-in Microsoft SQL Server data source.
Check out the articles via the links above - or our step-by-step deployment guides!
Nissan case study
Learn how Nissan uses the CANedge1, CANmod.temp and CANmod.input to diagnose prototype vehicle issues in remote deployments.
"The CANedge/CANmod is a convenient, easy-to-use and affordable tool for data collection"
VDL case study
Check out how VDL uses the CANedge2 to collect CAN/LIN data remotely via WiFi to enable faster diagnostics across their prototype fleets - and to reduce technician field visits.
"The CANedge2 is a compact, yet powerful data logger with an enormous amount of configuration options"
Comments from CSS
The introduction of Grafana-BigQuery and Grafana-Synapse play a core role in our strategy of making the CANedge increasingly 'agnostic' in terms of cloud providers. With the new integrations, we now offer a consistent architecture across all the top 3 clouds for deploying Grafana dashboard visualization. However, this is only part of the benefit.
As explained in our recent CAN bus telematics at scale article, Parquet data lakes are extremely powerful as they allow you to perform large scale analytics - with minimal coding effort. Further, the introduction of serverless SQL interfaces across all top 3 clouds (via Athena, BigQuery and Synapse) enable you to 'democratize' the access to your DBC decoded CAN/LIN data across your organization. For example, the standard SQL queries enable you to extract insights across terabytes of data (i.e. beyond memory) - without the need for complex scripts. Further, the SQL based data extraction is done in your cloud backend - super charging the processing speed and making the processing costs negligible in practice.
If you have not already deployed your own Parquet data lake, now is your chance - regardless of whether you're using Amazon, Google Cloud or Azure.
We are planning a number of major launches for the coming months - for early updates, follow us on LinkedIn!
This update was sent as part of our newsletter on 7 June 2024. You can also download it as a PDF.
Want updates like this in your inbox? Join our newsletter - or see all news.
