These Are The Robots That Will Be Doing Your Online Shopping in the Future

By James O Malley on at

Last year we delved inside the surprisingly intelligent world of Ocado's Hatfield warehouse. As we reported, it turns out that when you order your groceries online your shopping isn’t assembled by pushing a trolley around a supermarket - but it is instead prepared by a dizzying array of conveyor belts, lifts and robots, with only the occasional human for support.

It’s incredibly impressive - and seeing it in action, I felt as though I was catching a glimpse of the future. That was, until, Ocado showed us what it has been doing in its even newer warehouse, in Andover.

Forget the conveyors, forget the shelves - and instead imagine a grid system. Densely packed under each grid square are stacks of standardised totes on top of each other. There are no aisles between them for staff to retrieve stock, because there is no need: these totes are instead picked out from above by robots. The totes can be stacked up to 21 deep.

A simulated view of the warehouse. Each cube up top represents a robot moving around the grid - with colours indicating different states. Below is a map of the individual totes.

These robots are about the size of a washing machine, and traverse the grid system on metal rails - able to move on two axes (think rooks on a chessboard). To pick out a tote they simply have to slide over to the stack they need, and then they reach down and lift out what they need. Think something like Thunderbird 2 if, instead of depositing diggers into disaster zones, it was instead designed to run on wheels and was tasked with ensuring a carton of milk successfully made it into your shopping basket.

A full-sized representation of the new warehouse. It is pretty big.

Ocado’s Andover warehouse will eventually have 1100 of these robots operating simultaneously, with the central system managing traffic so they don’t bump into each other. Seeing it working in real life is weirdly impressive - though the robots are ostensibly doing something you wouldn't necessarily think was exciting (moving groceries around), it really does feel like a glimpse at the future.

I know what you’re thinking: What if the required tote is beneath another tote? If each robot can only carry one tote at a time, how does it get what’s below? And this is where it gets a little mind-blowing: The robots are able to swarm together and cooperate.

The robots move surprisingly fast - at 4m/s.

Say, for example, a customer has ordered a bottle of Diet Coke, but it’s in a tote stored beneath the packets of Cornflakes. One robot would hover over first, pick out the Cornflakes tote - and then another robot would glide in, reach down and pick out the Coke. Easy. Apparently the robots are capable of reaching down up to 20 layers of boxes.

Because of the standardisation built into this, red customer totes can be stored alongside green storage - meaning that there’s no need for separate storage of completed orders. The closest analogy I can think of is a hard disk, with each sector able to stop whatever "data" (whether a customer order, products for sale, or even maintenance equipment for the robots) is necessary.

What's more, because the storage system and the robots are all standardised, Ocado says that this new system should be even easier to maintain than what the old way of doing doings - and easier to expand too, as all you need to do is build some more rails and plug some more robots into the system.

4G and AI and Optimisation

Underlying this revolutionary warehouse structure is a constant push for optimisation and efficiency, as with the older conveyor system warehouse. Ocado describes the challenge as a “4D” optimisation problem - making sure that not only are the right totes in the right place across a three dimensional grid, but also making sure they are where they need to be at the right time. Perhaps unsurprisingly, Ocado are one of the biggest name uses of Google’s TensorFlow cloud machine learning system - and the company also makes use of everything from Amazon cloud storage to Nvidia’s GPU data crunching facilities.

So it all sounds rather futuristic - so perhaps it is unsurprising that Ocado has also had to develop some new technologies in-house to make sure that it all works.

The robot up close.

For example, because of the size of the warehouse the robots couldn’t simply operate using wifi because of distance and latency. So instead, Ocado has had to build them to use what is essentially 4G technology - but on an unlicensed part of the wireless spectrum (so not the same airwaves that your phone uses). This enables to the robots to check in ten times a second, so Ocado’s central system knows exactly where they are and what they are up to.

AI and machine learning is also being used under the hood on some lesser considered problems than simply how best to lay out the warehouse. Apparently AI will be used to maintain the army of robots, by using machine learning to spot signs of wear and tear in the analytics data collected in the firmware of each machine. The hope is that rather than had a machine break down in the middle of the grid, engineers will be able to spot ominous signs ahead of time and will be able to pull dodgy robots off of the grid for an MOT test. More generally, when it comes to overseeing the grid as a whole, rather than send people dangling over top a la Mission Impossible, the company are apparently considering using drones to fly overhead for visual inspections.


It feels unspoken to a certain extent, but ultimately the goal is obviously to remove as many humans from the process as possible - as that means cheaper goods and thicker profit margins for Ocado. This is definitely a problem that society at large is going to have to consider.

Already in the current Ocado warehouse, and seemingly in the new one too, they are almost there: Seemingly the only remaining need for humans is “picking”. That is to say, taking items from the storage totes and dropping them into shopping bags mounted in customer totes.

The reason humans are still needed is a long running problem in automation: picking stuff up. Not only does Ocado need to transfer objects of different sizes into boxes and bags, but it also needs to do it carefully. Humans have an instinctive ability just how hard to grip something to lift: You apply a different amount of force lifting up, say, a bag of flour than you do an egg. Machines are less good at this, which is presumably why Ocado is shovelling money into its “Soft Manipulation” project. If this video from Ocado Technology is any indication… we’re clearly getting there slowly:

On our tour of the new Andover warehouse we saw a similar machine in action - which used a much simpler suction system to pick up cans from one tote and drop them in another.

Grocery Robots As A Service

What’s also interesting though isn’t just the technology Ocado is building - but also the new business model. The new warehouse is a template for what the company calls “Ocado Smart Platform” - OSP. The company’s long term goal is to take the technology it has developed and offer it to other retailers who need an “end to end” system for selling stuff online.

The idea is that other companies simply provide the warehouse and the merchandise, and Ocado come in and build and maintain a robot grid. Think of it like subscribing to Salesforce or Adobe Creative Cloud, but with a hardware side, as well as software.

Ocado’s sights are set internationally, as competition laws would prevent Ocado from working with its grocery rivals at home. The company tells me it especially wants to target supermarket chains in the likes of France, Italy and Spain, as well as further afield in Europe, North America and Asia, where online grocery shopping isn’t very advanced. Apparently where it does exist, it’s mostly a case of ordering online and then having to drive to the supermarket to pick up your goods - a long way from Ocado’s robots helping bring your shopping direct to your front door. At the time of writing, the company has already done a deal with upmarket Canadian chain Sobeys.

So could the Ocado Smart Platform end up being the secret sauce that ends up powering the next generation of online shopping? No doubt Amazon is looking on with interest too. Say what you will about the role of humans in this increasingly robotic vision of the future, but by sharing its vision with me, Ocado is clearly not lacking the ambition a system like this requires. In fact, even though Andover has only just opened, the company is already hard at work building its next robot warehouse in South East London, which it says will be even larger, and will support around 3,500 robots.

Read More: Part 1 of our Ocado feature, looking at the intelligence at work in the current warehouse. It's pretty cool.