A human driver perceives the road with two eyes, two ears and a lifetime of experience. A self-driving car has none of that by default. Everything it knows about the street ahead, the cyclist alongside and the truck braking in front must come from sensors, and from software that turns raw data into decisions in a fraction of a second.
Three sensor technologies do most of that work: cameras, radar and LiDAR. Each one perceives the world in a fundamentally different way, and each has blind spots the others can cover. Understanding the trio explains not only how autonomous vehicles work, but also why companies argue so passionately about which sensors are truly necessary.
This guide walks through each technology in plain English, then looks at how they are combined.
Cameras: Rich Detail, Human-Like Weaknesses
Cameras are the most intuitive sensor because they see roughly what we see: color, texture, shapes and light. An autonomous vehicle typically carries multiple cameras covering every direction, feeding images to neural networks trained on vast libraries of driving scenes. Those networks learn to recognize lane markings, traffic lights, signs, pedestrians, cyclists and the subtle cues that matter in traffic, such as a brake light or a turn signal.
Cameras have two enormous advantages: they are inexpensive and compact, and they capture information no other sensor can. Only a camera can read the color of a traffic light or the text on a sign.
Their weaknesses mirror human eyes. Cameras struggle in darkness, fog, heavy rain and glare, and can be confused by shadows, reflections and unusual objects they were never trained on. Critically, a single camera does not directly measure distance; depth must be inferred by software, and inference can be wrong. In a task where misjudging distance by a few meters matters, that is a serious limitation to engineer around.
Radar: The All-Weather Workhorse
Radar has guided ships and aircraft for generations, and automotive radar shrinks the same principle into a palm-sized unit behind the bumper. The sensor emits radio waves, which bounce off objects and return; timing the echo gives distance, and the Doppler shift of the reflected wave gives the object’s speed directly. Radar does not estimate how fast the car ahead is moving; it measures it, instantly and accurately.
Radio waves barely notice rain, fog, snow, dust or darkness, so radar keeps working in exactly the conditions that blind cameras. This reliability is why radar underpins adaptive cruise control and emergency braking in millions of ordinary cars today.
The trade-off is resolution. Traditional automotive radar perceives the world as a coarse collection of reflections, strong enough to say something metallic is ahead and closing fast, but too blurry to say what it is. Stationary objects are especially tricky, because the world is full of harmless stationary metal, and filtering it out without ignoring a genuinely stopped vehicle is a classic radar challenge. Newer high-resolution imaging radars improve on this considerably.
LiDAR: Painting the World in Laser Light
LiDAR, short for light detection and ranging, works like radar but uses pulses of laser light instead of radio waves. The sensor sends out millions of harmless, invisible pulses per second in all directions and times their reflections. The result is a point cloud: a precise three-dimensional map of everything around the car, accurate to a few centimeters, showing the exact shape and position of vehicles, curbs, poles, pedestrians and debris.
That direct, per-point distance measurement is what makes LiDAR beloved by many autonomy engineers. It does not infer depth; it measures it, in daylight or total darkness. Where a camera sees a flat image and must deduce that a shape is a child near the curb, LiDAR geometrically confirms an object of that size at that exact spot.
LiDAR has its own limits. Laser light scatters in dense fog, heavy rain and snow, so it is not immune to weather, and it cannot read colors or text, so it will never replace cameras for traffic lights and signs. It was also historically the expensive sensor, though prices have fallen dramatically as compact solid-state designs replace the spinning rooftop towers of early prototypes.
Sensor Fusion: Making Three Views Into One
The real magic happens when the streams combine, a process called sensor fusion. The car’s computer aligns data from every sensor in time and space, then builds a single model of the surroundings: what objects exist, where they are, how they are moving and what they are likely to do next.
Fusion exploits complementary strengths. Consider a pedestrian stepping out at night. The camera may barely register a dim shape, LiDAR confirms a human-sized object at a precise distance, and radar reports its movement toward the road. Individually, each signal might be ambiguous; together, they justify braking. Redundancy also protects against failure: if one sensor is blinded by glare, mud or malfunction, the others keep the picture alive.
Disagreement between sensors is itself information. If the camera sees nothing but radar insists something is there, the system can slow down and increase caution rather than gamble on either sensor being right. Designing those arbitration rules well is a large part of autonomous vehicle safety engineering.
Why Companies Disagree About Sensors
Not everyone in the industry uses the full trio. Some developers argue that because humans drive with vision alone, sufficiently advanced cameras plus artificial intelligence should suffice, and that fewer sensor types mean lower cost and simpler systems. Others, including most robotaxi operators, consider LiDAR and radar essential redundancy for a machine that lacks human judgment.
This is a genuine engineering debate, not a settled question. Camera-first systems keep hardware cheap and lean on software; multi-sensor systems accept extra cost for overlapping layers of certainty. Falling LiDAR and imaging-radar prices are gradually softening the cost side of the argument.
Beyond the Big Three
Several supporting technologies round out the picture. Ultrasonic sensors handle very short range work such as parking, while high-precision GPS and inertial sensors track where the vehicle is and how it is moving. Many systems also compare live sensor data against detailed prebuilt maps, and some vehicles carry microphones to detect emergency sirens. Perception is a team effort involving far more than the headline sensors.
Frequently Asked Questions
Which sensor is the best for self-driving cars?
There is no single best sensor, because each measures something different. Cameras provide detail and color, radar provides speed and all-weather range, and LiDAR provides precise 3D shape. The strongest systems fuse several types so the weaknesses of one are covered by another. The industry debate is not about which sensor wins, but about how much redundancy is enough for safety.
Can self-driving cars see in the dark?
Better than humans can, in many respects. Radar and LiDAR are completely independent of ambient light, so they perceive obstacles at night exactly as they do at noon. Cameras still struggle in darkness, which is one of the main reasons many developers pair them with active sensors rather than relying on vision alone after sunset.
What happens if a sensor fails or gets dirty while driving?
Autonomous systems are designed with redundancy and self-monitoring. Sensors report their own health, many have heaters or washers to clear rain, ice and grime, and overlapping coverage means other sensors can compensate temporarily. If perception degrades beyond safe limits, the system is designed to respond conservatively, such as slowing down, alerting a human, or pulling over, rather than continuing blind.
Why do some robotaxis have spinning domes on the roof?
Those domes are LiDAR units, positioned high so their lasers sweep the surroundings with the fewest blind spots. Early designs physically rotated to scan in all directions; newer solid-state LiDAR achieves similar coverage with little or no visible movement, which is why sensors on recent vehicles are increasingly hidden in bodywork and roof modules instead of perched on top.
Final Thoughts
Self-driving cars do not see the road the way people do; they measure it, from three different directions at once. Cameras contribute meaning, radar contributes certainty about motion, and LiDAR contributes exact geometry, with fusion software weaving the streams into a single living map. However the industry’s sensor debates resolve, the underlying lesson is already clear from the driver-assistance features in everyday cars: machines perceive best when several imperfect senses check each other, which is, fittingly, not so different from how nature solved the problem.