
- Sensing for Automation
- Sensing for Science
- Sensing for Fun
Advances in sensing and Artificial Intelligence are reshaping robotics and automation right now. As these technologies become more capable and affordable, we can look at new ways to apply them.
Sensing
Sensing starts from the crudest interaction between say a probe and its environment — a resistance changing — encompasses cameras, microphones, ascending through to extraordinary orders of magnitude. Capacitive sensing, enough to read a fingerprint or feel a raindrop before it lands, to interferometry that exploits the wave nature of light itself, a technology so precise it can detect gravitational waves: ripples in the very fabric of spacetime smaller than one ten-thousandth the width of a proton; sensitive enough to map the density of geological formations kilometers underground. From a wire touching a surface to an instrument that listens to the geometry of the universe itself — the attempt to make the invisible, the distant, and the almost-unimaginably subtle speak in numbers we can understand.
Physics vs Machine Learning
Physics-based models represent the distillation of natural law into equations that can predict, with extraordinary precision, the behavior of systems we understand well. As systems grow in complexity — a turbulent fluid, a biological organism, a city’s traffic network, a self driving car — the equations proliferate, the complexity multiples. This is precisely the domain where machine learning steps in, not by understanding a system, but by learning it. It can adapt as the system drifts, update as new data arrives, and control processes whose dimensionality and nonlinearity would defeat any analytically derived controller. Physics-based models anchor understanding in first principles and perform brilliantly where the science is settled and the system is clean; machine learning extends that reach into the vast, messy, high-dimensional remainder of the real world — the complex, the coupled, the partially observed, and the poorly understood — offering control and insight where equations alone will not suffice.
Communication and Control
As the number of smart sensors and semi-autonomous systems grows, the architecture of communication and control becomes as consequential as the intelligence of any individual node. A single smart sensor is useful; a thousand of them, networked and coordinating, become potentially something categorically different. Low-latency wireless protocols, edge computing, consensus algorithms, and hierarchical control architectures that mirror, perhaps not coincidentally, the very structure of biological nervous systems. The range of sensors and the bandwidth available to these systems allows a density of coordination that has no precedent in nature. A simple example could be a soil moisture sensor, coupled with the weather forecast to schedule and control an irrigation system. As these networks grow toward planetary scale — sensors in the ocean, in the atmosphere, embedded in living tissue, woven into civil infrastructure — communication and control becomes, in the most literal sense, the central nervous system.