Revolutionizing Real-Time Vehicle Data Processing with Workbench Sensoris
About The Customer:
Our customer is a leading automotive company with global operations focused on enhancing vehicle data management and operational efficiency.
Business Challenges:
- Lack of Real-Time Insights: The customer faced difficulties in monitoring vehicle data streams, leading to inefficiencies in decision-making and response times.
- Data Overload: Managing and interpreting vast amounts of vehicle data without a structured approach hindered effective analysis.
- Compliance Concerns: Ensuring data privacy while processing and visualizing vehicle routes was a significant challenge.
- Latency Issues: Inconsistent event delivery times affected the reliability and timeliness of data insights.
Our Solution:
- Workbench Sensoris Application:
- Developed a real-time data processing application to capture data from vehicles as it is generated.
- Implemented business logic to process and forward this data to an API, ensuring efficient data handling.
- Data Visualization on Grafana:
- Overview of Delivered Events: Tracks total events received, delivered, invalid, unexpected, and dropped.
- Drive Statistics: Displays total distance travelled, processed distance, and time metrics (including anonymization duration).
- Metrics on Data Volume: Monitors event latency, total data size forwarded, and the number of API calls made.
- Overview of Received Events: Provides insights into various event types, including geographical data (latitude/longitude) and operational metrics (engine status).
- Latency Report: Measures latency from event receipt to forwarding, ensuring timely data transmission.
- Map Visualization: Visualizes vehicle routes with distinct colour codes for anonymized sections, enhancing clarity in data privacy compliance.
Embitel Impact:
- Improved Operational Visibility: Real-time insights into event statuses and drive statistics enhanced monitoring capabilities and operational efficiency.
- Optimized Drive Metrics: Detailed statistics on vehicle performance enabled stakeholders to analyse and improve operational strategies effectively.
- Monitored Data Latency and Volume: Tracking event latency and managing data volumes led to more reliable and timely data transmission, improving overall data integrity.
- Enhanced Route Tracking: Clear visualization of routes and anonymized sections facilitated compliance with data privacy standards, ensuring stakeholders were well-informed and compliant.
Tech Stack
- Azure EventHub
- PySpark
- Spark Streaming
- Data bricks
- Azure durable functions
- Azure API,
- Azure DevOps
- CICD