Skip to main content
The Dark Art of Postmortem DebuggingRead
Illustrative. Synthetic data.
01 / The instant

The bus went quiet at 04.700. The head unit noticed at 04.731.

Upload a CAN trace and a bugreport together. Frames, VHAL property events and the infotainment log land on one clock.

Bus
DLT
VHAL
Kernel
Car Svc
OTA
0x3B0
TCU
The instant
04.700s
0x3B0 gap
1 200 ms
expected 100
04.700
Bus
500 kbit/s
04.5480x18F80 58
04.6000x3B001 00
04.6500x0C8D8 D0
04.7000x3B0none
04.7510x2F1CA A5
CAN
none
VHAL
04.712timeout
Logcat
04.731 ECarService
Kernel
no event: not hardware

The frame that never arrived at 04.700 is the instant the head unit first said something was wrong.

Automotive · CAN, VHAL and Android on one clockIllustrative. Synthetic data.
Bus load
DLT
VHAL
CarService
Kernel
OTA
0x3B0 missing
TCU fault
0100 %
Bus load
38 %
The instant
04.700s
0x3B0 last seen 04.600 · next 05.800
11 frames missing, 100 ms schedule
01000 ms
0x3B0 gap
1 200 msexpected 100
04.700
Ticker
Bus · 500 kbit/s · 4 ids showntime runs right
04.5810x18F80 58
04.6000x3B001 00
04.6170x0C8D8 D0
04.6340x2F1CA A5
04.6510x0C896 FD
04.6670x18FA8 47
04.6850x1A0E1 09
04.7000x3B0none
04.7160x1A063 DF
04.7350x0C894 F7
04.7480x1A04D 47
04.7680x18F74 42
04.7820x0C85E D5
CAN 0x3B0
none
expected 04.700
VHAL
04.712TCU_STATUS property timeout
Logcat IVI
04.731 ECarService: telematics unreachable
Kernel
no kernel event until 05.200: not the hardware

The frame that never arrived at 04.700 is the same instant the head unit first said something was wrong. One clock, every source, read across at that instant.

01 / The instant

The bus went quiet at 04.700. The head unit noticed at 04.731.

Upload a CAN trace and a bugreport together. The frames, the VHAL property events and the infotainment log land on one clock, and you ask what happened in the 31 ms between.

Buscandump · .asc · .blf · .trcTraceDLTAndroidbugreport · dumpsys car_serviceKerneldmesg from the vehicle BSP
The cluster stays put. This column scrolls beside it.
02 · The chainIllustrative. Synthetic data.
CAN bus
ECU
VHAL
Framework
Kernel
IVI
Cluster
ADAS
one failure, four lamps, no tool that reads the rowwhy it is hard
01
Invisible boundaries between layers

A CAN bus signal crosses ECU boundaries, passes through vehicle HAL abstractions, and surfaces as an Android framework event. The failure chain spans four or more layers, and no existing tool connects them.

02
A distributed vehicle software system

Issues cascade across IVI head units, digital clusters, ADAS modules, and connectivity ECUs. A single root cause in one compute node triggers symptoms across the entire vehicle software system.

03
CAN bus at scale

1 to 10 GB and more of CAN trace data, thousands of signals at 100 Hz across dozens of ECUs. Correlating that with Android logs, VHAL dumps and kernel events by hand is a multi-day effort.

04
Safety-critical stakes

The cost of a missed bug is enormous.

13.4 M
vehicles recalled for software, 2024
1 in 2
of all recalls
55 %
of launches delayed by software integration
02 / Why it is hard

Why vehicle software debugging is hard

Failures cross invisible boundaries between vehicle hardware, ECU firmware, VHAL, and the Android stack. No single tool sees the full chain.

03 · Five rulers, then oneIllustrative. Synthetic data.
Before · manual cross-tool correlationfive tools, five rulers
CANalyzer
Vector CANalyzer or PEAK PCAN for CAN bus trace analysis
adb logcat
ADB logcat for Android framework and application logs
dmesg
dmesg and kernel console for BSP and driver events
vendor tool
Vendor-specific tools for ECU diagnostics and VHAL dumps
spreadsheet
Manual timestamp correlation across all sources, often in spreadsheets
Days of work across multiple teams to connect the dots
After · upload and askone ruler, one cursor
01Upload bugreport + CAN trace to logcat.ai
02Ask "Why did the IVI reboot?" or "What caused the VHAL timeout?"
03The investigation traces the full chain across every layer and delivers root cause with citations, for you to review
CAN
none
VHAL
04.712TCU_STATUS timeout
Logcat
04.731 ECarService: telematics unreachable
Kernel
no event
Root cause in minutes, with the full cross-layer evidence chain
03 / Before and after

From five clocks to one

Vehicle software debugging today means stitching together five disconnected tools, each with its own clock. logcat.ai replaces that workflow with one upload and one question.

04 · ReadoutsIllustrative. Synthetic data.
Four readouts, one clusterfeatures
01
Powered by Deep Research

An investigating agent that works cross-layer vehicle issues step by step. It traces CAN signals through VHAL to the Android framework, correlates thermal events with driver behavior, and builds a root cause report you review before acting on it.

02
Delta for OTA regression detection

Compare bugreports and CAN traces across BSP versions, OTA updates, and vehicle variants. Isolate regressions that appeared between firmware releases. Catch what changed before it reaches production.

Learn more about Delta
03
Cross-layer correlation

Trace issues from CAN bus signals to VHAL property events to the Android framework to the kernel. The full failure chain is reconstructed across every boundary in the vehicle software stack.

04
HW/SW root cause separation

Determine whether an issue originates in vehicle hardware, BSP firmware, Android framework, or application code, and end the cross-team blame game in minutes instead of days.

Part of the logcat.ai platformthe same platform that powers Android debugging for device makers and telecom teams
Deep Research

Multi-step investigation that traces issues across every layer of the vehicle stack.

Delta comparison

Compare logs across OTA versions, vehicle variants, and BSP releases to isolate regressions.

9-subsystem analysis

Automated analysis across CPU, memory, network, power, storage, security, and more.

04 / Features

Built for the distributed vehicle software system

Tools that understand the full vehicle stack, from CAN bus signals to Android framework events, on the one clock the hero already showed you.

05 · Two runs, one cursorIllustrative. Synthetic data.
Same drive · two firmware revs · one cursorDelta
04.700
Build Abefore the OTA
04.5840x2F159 8D
04.6000x3B001 00
04.6180x0C836 8C
04.6330x1A027 36
04.6480x1A002 72
04.6670x0C8CC 3C
04.6820x2F130 DF
04.7000x3B001 00
04.7160x18F75 C3
04.7350x1A01F CA
04.7500x18F7D 90
04.7660x18FBD 04
04.7840x0C85F 25
Build Bafter the OTA
04.5810x18F80 58
04.6000x3B001 00
04.6170x0C8D8 D0
04.6340x2F1CA A5
04.6510x0C896 FD
04.6670x18FA8 47
04.6850x1A0E1 09
04.7000x3B0none
04.7160x1A063 DF
04.7350x0C894 F7
04.7480x1A04D 47
04.7680x18F74 42
04.7820x0C85E D5
What changed
New on build B
0x3B0 gap 1 200 ms
absent on build A
New on build B
VHAL TCU_STATUS timeout
and the CarService error 19 ms later
Same on both
bus load 38 %, kernel quiet
so not the hardware, not the driver

The same second of the same drive on both builds. The frame that only goes missing on the new build is the regression, and the log lines that appear only there are its symptoms.

05 / Delta

OTA regression detection with Delta

Upload CAN traces, bugreports, and kernel logs from before and after an OTA update. Delta correlates timestamps across all sources and isolates exactly what changed, and what broke.

Learn more about Delta
06 · Your lampsIllustrative. Synthetic data.
Which lamps are yourswho uses this
01
IVI / head unit engineers

Debug infotainment crashes, display failures, audio routing issues, and navigation hangs across Android Automotive head units.

CANVHALCarServiceLogcatKernelOTA
02
AAOS platform teams

Investigate VHAL integration issues, CarService failures, thermal throttling, and BSP-level driver problems across vehicle variants.

CANVHALCarServiceLogcatKernelOTA
03
HMI / display engineers

Debug UI rendering issues, touch input latency, display pipeline failures, and animation frame drops across vehicle displays and instrument clusters.

CANVHALCarServiceLogcatKernelOTA
04
Vehicle integration and QA

Validate OTA updates, compare pre and post update logs with Delta, and catch regressions before they reach production vehicles.

CANVHALCarServiceLogcatKernelOTA
06 / Who uses this

Automotive engineers across the distributed vehicle software system

Each team lives on a different part of the cluster. The same upload answers all of them.

07 · Four lanes inIllustrative. Synthetic data.
LaneWhat we readWhat it carriesHow to record it
01
Android bugreports

Full system diagnostics from IVI, digital cluster, and ADAS modules running Android Automotive OS.

01Connect USB to the IVI or head unit
02Run adb bugreport
03Upload the generated zip file
02
CAN bus traces

candump text, Vector .asc and .blf, and DTS .trc traces read directly; PCAN-View .trc and .mf4 via a text export. Vector recordings upload well past the ordinary size limit.

01Use Vector CANalyzer, PEAK PCAN, or candump
02Save the trace as .blf or .asc, or export to candump text
03Upload the trace files
03
VHAL and CarService logs

Vehicle HAL property events, CarService dumps, and AAOS-specific framework diagnostics.

01Run dumpsys car_service on the device
02Capture the VHAL property logs
03Export as a text file
04
Kernel and BSP logs

dmesg from vehicle BSPs: device tree issues, thermal zone events, driver probe failures.

01Run dmesg on the vehicle BSP
02Capture boot and runtime logs
03Upload for driver and thermal analysis
logcat.ai supports plaintext and structured CAN formats. Binary-only proprietary formats require export to a supported format first.
07 / Inputs

Supported log types, and how to export them

Upload logs from IVI head units, digital clusters, ADAS modules, and CAN bus capture tools. Each lane on the cluster is one of these four sources, captured from your vehicle development setup.

08 · AnalyzersIllustrative. Synthetic data.
08 / Analyzers

Analyzers for the vehicle stack

From IVI traces to kernel crash dumps, every signal has a dedicated deep-dive.

09 · FAQIllustrative. Synthetic data.
09

Frequently asked questions

Common questions about automotive log analysis.

Q01
What CAN bus formats do you support?

candump text output, Vector ASCII (.asc) and Vector binary (.blf) logs, and DTS diagnostic (.trc) traces upload as they are; the Vector formats include CAN FD and 29-bit extended identifiers. PCAN-View .trc files and .mf4 measurement files need a text export first, and the automotive guide has the steps. Vector recordings upload well past the ordinary size limit, with thousands of signals across dozens of ECUs.

Q02
Can you correlate CAN data with Android logs?

Yes. Delta accepts CAN traces alongside Android bugreports and kernel logs. It correlates timestamps across all sources to trace issues from vehicle bus signals through VHAL to Android framework events, finding cross-layer root causes automatically.

Q03
Do I need specific tools to export logs?

For Android logs, standard ADB is sufficient. For CAN bus data, Vector CANalyzer or CANoe recordings and candump output upload as they are; the formats question above says which vendor formats need a text export first. VHAL and CarService logs can be captured with standard Android dumpsys commands.

Q04
What vehicle platforms are supported?

logcat.ai works with any Android Automotive OS deployment: from IVI head units to digital clusters to ADAS modules. We support ARM and x86 architectures, and our kernel analysis covers vehicle-specific BSPs from major silicon vendors.

Q05
How does Deep Research work for automotive?

Deep Research is an investigating AI agent that works vehicle issues step by step. It parses CAN signals, traces VHAL property events, correlates framework logs, and searches for known issues, building a root cause report with citations in 5 to 10 minutes, for you to review.

Q06
How does Delta help with OTA regressions?

Upload bugreports from before and after an OTA update. Delta compares them side by side, identifying new crashes, changed behavior, performance regressions, and driver failures that appeared between firmware versions. It is particularly useful for BSP updates where regressions can be subtle.

Q07
Is my log data secure?

Your log data is encrypted in transit (TLS 1.3) and at rest (AES-256), processed in your own tenant, and never used to train AI models. Files are deleted after 90 days, or immediately from your dashboard. Enterprise plans offer on-premise deployment for regulated or air-gapped environments.

10 · StartIllustrative. Synthetic data.
CAN
DLT
VHAL
CarService
Kernel
OTA
Delta
Research

Start analyzing your vehicle logs.

See how logcat.ai can reduce your automotive debugging time from days to minutes. Full access during your 30 day pilot.

Every lamp on. That is the whole cluster, read at once.
day 0day 30
Pilot
30 days
full access