Custom built robots to solve real world problems
Menu

Andy Blight

BrainsCranes_Thumb_02

Brains, Cranes and Other Ordeals

, , , , , , , , , , , , ,

Global Online Premiere for Behind-the-Scenes Robotics Documentary, “Brains, Cranes and Other Ordeals”

The global online premiere of Real Robotics’ feature-length documentary, “Brains, Cranes and Other Ordeals” takes place at 7pm GMT on November 24th 2020 on the Real Robotics YouTube channel.  

The film documents the Real Robotics team in their bid to win the Mohamed Bin Zayed International Robotics Challenge (MBZIRC) hosted in Abu Dhabi in February 2020. Real Robotics was the only UK team to qualify for the last stages of the contest.

The exciting 55-minute film was developed in-house and offers a fascinating, behind-the-scenes insight into the high-octane world of competitive robotics – where the world’s leading robotics researchers compete for the prestigious winner’s title and $5million worth of prize money.

Click on the YouTube icons below to watch the documentary on the 24th of November or if you can’t wait until the 24th, watch the trailer.

Brains, Cranes and Other Ordeals
Brains, Cranes and Other Ordeals - Trailer

 

Share this post using the links below.

Covid19-LBA-TeamPhoto

Real Robotics fighting COVID-19: The Tale of Engineers, Robots, and a Deadly Virus

, , , , , , , , , , , , , , , ,

Real Robotics Team at the University of Leeds has responded to the COVID-19 pandemic with autonomous robots for on-demand intelligent precision disinfection. The robots, developed by researchers in the Self-Repairing Cities project at the Universities of Leeds, Birmingham, Southampton and UCL, are equipped with onboard sensing and computation power that enables them to navigate, identify targets, and disinfect them. This effort contributes to help in controlling the virus transmission from frequently touched surfaces in public spaces.

The recent COVID-19 outbreak has dramatically influenced our lives. Germs and viruses have always been surrounding us and will continue to exist and evolve. Disinfecting public spaces is undoubtedly essential to control the spread of the virus. Public Health England has recently published coronavirus survival data on surfaces which reports that the virus can survive up to 72 hours on surfaces depending on the type of surface, humidity, and temperature. It takes an infected person to cough or sneeze in his/her hand and touch a surface in public to create a point of infection that can potentially hunt down the next victim touching that surface. That surface, for instance, can be a door handle of a nearby shop or a public bench.

Current disinfection practices of public places usually aim for maximum coverage of spaces. While these practices can help in attenuating the spread of disease, they often lack consistency and accuracy, which can lead to inadequate surface coverage, leaving behind potential infection spots, or over usage of disinfectant that can lead to unnecessarily public exposure to chemicals.

Covid19-LBA-HuskySprayNozzle
Covid19-LBA-HuskySprayingDoorHandle

At Real Robotics, we have identified the current challenges, and we decided to put our multidisciplinary team of researchers, engineers, and robots in action. We needed our system to address mobility, modularity, consistency, and accuracy of the disinfection operations in public spaces. To support this effort, we repurposed part of the Self Repairing Cities project that is supported by the Engineering and Physical Sciences Research Council, part of UK Research and Innovation.

Covid19-LBA-HuskySprayingBench
Covid19-LBA-ProcessedBench

In the past ten weeks, our team has tirelessly worked to design and build a smart robotic disinfection system prototypes for precision spray systems. We initially focused on automation to address mobility, to cover multiple spots quickly, and on consistency, to make sure the operation complies with specific standards. We designed and built two systems to serve our goals; the first is based on a ground wheeled robot (HUSKY), and the second is based on a legged robot (LAIKAGO). Both robots are equipped with integrated custom-built pump-spray systems to handle spraying the disinfectant solution. It was then the time to go beyond automation toward robot intelligence and advanced autonomy to address the modularity and accuracy of the disinfection operation. Each robot is equipped with LiDARs, inertial sensors, and visual and depth sensors that enable the development of navigating autonomously, identifying target areas, and spray them as needed ensuring coverage and avoiding overuse of chemicals.

Covid19-LBA-LiakagoSpraying Bench
Covid19-LBA-TeamPhoto

For us to understand the disinfection requirements, we have identified a range of surfaces used or touched in public (hotspots) and study their geometries to optimise disinfection. It is hard to assume specific contact points or angles of contact between people and the used surfaces, which incentivized us to think of the disinfection process as a three-dimensional coverage problem instead of two-dimensional spraying. For spray precision, the multi-nozzle spray module is mounted on a multi-degrees of freedoms robotic manipulator and visual and depth sensors. We are developing detection and tracking of hotspots based on machine learning and compute manipulator-pump trajectories for effective disinfection.

Covid19-LeedsCityCentre-Liakago- CloseUpInArcade
Covid19-LeedsCityCentre-HuskySprayingBench

In the past few weeks, we have tested the viability of our systems in the real world. So far, we have run some robot tests and collected data from two locations, Leeds Bradford International Airport and Leeds City Centre, in collaboration with Leeds Bradford Airport and Leeds City Council. The testing helps us further to understand operational challenges and different scenarios of disinfection.

We believe that robots and intelligent systems will play an essential role in public health, and we are eager to contribute to the national and global health efforts to combat COVID-19.

Covid19-LeedsCityCentre- Team2

The team involved in this project (alphabetical order) were:

, , Camilo Gonzalez Arango, , Christopher Peers, Jake Smith, , , , , Mohammadali Javaheri Koopaee, , , Peter Mooney, , Tony Wiese,

TeamPhoto

MBZIRC 2020

, , , , , , , , , , , , ,

The Mohamed Bin Zayed International Robotics Challenge (MBZIRC) is a biennial international robotics competition that “aims to inspire future robotics through innovative solutions and technological excellence.”  There were three challenges in the 2020 competition, two of which complemented the work being done by the self repairing cities team. More details about the challenges for the 2020 competition can be found here: https://www.mbzirc.com/challenge/2020.

Preparation

I started with the University in October 2019 so I missed out on much of the preparation work done by the team. These two videos show what the team did before I started.

Update 1.
Update 2.

There was a lot of software to be written for challenges 2 and 3 so the tasks were split up: Bilal wrote the system design documents, Simon developed the brick recognition code, Vivek working on the drone flight planning software and I wrote the drone control and accessories software.  The bulk of the software was written using the Robotics Operating System (ROS) as a way of splitting up the problem into manageable chunks (ROS nodes) and as a method communication between the drone and the base station.  This approach also allowed us to reuse some nodes that had been developed by other people, e.g. the DJI OSDK node to interface with the DJI M600 drone autopilot.

As I was new to robotics, I found this quite challenging as there was a lot of new things to learn in a very short time but after a couple of weeks, I started to get the hang of it.  I created a reliable ROS set up for the numerous Raspberry Pis that we were using to control the drones and the virtual machines that we were using to develop on.  I then started writing the easier ROS nodes: the first to control the crane for challenge 2 and the next to control the water pump for challenge 3.  Then, as I understood ROS better, I developed the more complicated ROS nodes that communicated with the base station and controlled the flight of the drones.

Alongside the software work, there was lots of hardware development going on.

Nick Fry and Moustafa Motawei were working on challenge 1 developing a long arm to grab a ball off a moving drone and another drone to locate and pop balloons.

The arm for challenge 1.
The arm for challenge 1.

Peter Mooney was working on the water pump for challenge 3.  This photo shows the water pump fitted on one of our M600s. The water bag can be seen underneath the drone with the pump, Arduino control box and the gimbal mounted nozzle. Additionally, two cameras were fitted later, a thermal camera that was used to locate the fire and a RealSense camera that was used to position the drone at a close but safe distance from the fire.

An early version of the water pump mounted on an M600.
An early version of the water pump mounted on an M600.

Jake Smith developed the crane for challenge 2, an amazing looking machine.  This crane was designed with three winches to prevent the load spinning in the down wash of the drone rotors. This arrangement also allowed us to level the brick for more accurate placement. The three armed gripper was fitted with permanent electromagnets (PEMs) controlled by a Bluetooth controller (no wires) that we used to grip and release the brick.

Testing the crane.
Testing the crane.

Our team of 4th year students: Joe, Wesley, Emlyn and Ralph were developing a ground robot based around a Husky UGV. They were develpoing the “roller coaster” mark 2, an add-on unit to receive bricks from a drone as well as all the software to control pick up a brick and place it on the wall “foundation”. 

The Husky ready to go.
The Husky ready to go.

Final testing

Final testing started in earnest in the middle of January and things got very hectic. The pump could accurately fire water over 3 metres and the control software for it worked was finished. 

The crane was waiting for parts until a few days before we left (supply problems caused by some virus or other in China) so we could not integrate the software until we got to the competition.

The flight control software worked well in simulation using the Pixhawk SITL code, but there was nothing equivalent for the DJI drones, so the software to fly the drones was completely untested.  Fortunately, Mohammed had just started and, just in the nick of time, we had some code that should fly but was untested. 

While all this was going on, we were arranging to ship the bulky equipment over to Abu Dhabi in huge packing crates (see below).

The packing crates arrived.
The packing crates arrived.
This crate was huge!
This crate was huge!

The competition

The day before we travelled, the Real Robotics lab was a hive of activty, people coming and going all day, filling up suitcases with tools, equipment and batteries that we needed to hand carry. The flight was due to leave Manchester airport around 10am so we had to leave Leeds at about 4am so we could check in on time. Not much time for sleep that night!

Getting on the bus to Manchester Airport.
Getting on the bus to Manchester Airport.
Excited to be finally on our way!
Excited to be finally on our way!

After a comfortable flight, we arrived at the hotel at around 9pm local time, had a bite to eat and then off to bed. The next morning, we set off at 7am for the exhibition centre to find our stand and unload the crate.

Our hotel.
Our hotel.
The front of the exhibition centre.
The front of the exhibition centre.

There was no time to waste as we had three days of rehearsals for the challenges followed by two days of challenges and a final day for the grand challenge. We worked for about 14 hours each day, starting at 7am, preparing for and doing the rehearsals/challenges until they finished at around 3pm, taking a pool and food break and then back to work until 11 or 12.  

Our stand at MBZIRC.
Our stand at MBZIRC.
Another successful rehearsal.
Another successful rehearsal.
The front of the stand during the day.
The front of the stand during the day.
The back room at the stand.
The back room at the stand.

On the last day of the rehearsals, we were pleasantly surprised to be in the middle of the table. Our attempts at doing the challenges autonomously had failed due to many little annoying things going wrong so each time we had to fallback to doing the challenges manually. Very frustrating after all the work that the team had put in.

Here are some photos of the challenge arena with the team in action.

The arm preparing to strike in challenge 1.
The arm preparing to strike in challenge 1.
The Husky carrying a brick.
The Husky carrying a brick.
Entering the challenge 3 arena.
Entering the challenge 3 arena.
Getting the crane ready for flight.
Getting the crane ready for flight.
We placed some bricks on the wall.
We placed some bricks on the wall.
The kitchen area in the fire challenge building.
The kitchen area in the fire challenge building.

At the end of the two days of the challenges, we ended up in the middle of the table and the team was asked if we wanted to compete in the Grand Challenge. We went for a meal at a restaurant in the hotel and decided that we would go for it. Over dinner, someone dreamt up a “surefire” plan to improve our scores with the UGV in challenge 3.  It involved installing multiple pumps and a huge water tank so was a big challenge to implement overnight. It also gave us one last chance to try some form of autonomous flight on challenge 3, so after the meal, we went back over to the exhibition centre, made the last few tweaks to the software and pumped up the Husky!

Last minute tuning of the fire detection algorithm.
Last minute tuning of the fire detection algorithm.
Grand challenge arena.
Grand challenge arena.
The pumped up Husky.
The pumped up Husky.
Grand challenge arena showing the fire challenge building.
Grand challenge arena showing the fire challenge building.

The next day, our grand challenge slot was at 9am, so we tried one last time. The drone flew on its own, found the building, searched for and found the fire and then tried to extinguish the fire. Unfortunately, the drones aim was off by about 30 cm so we scored nothing but it proved our autonomous software worked.  The team switched back to manual mode and then finished the challenge. The final results were: challenge 1, 19th; challenge 2, 10th; challenge 3, 11th; and the grand challenge, 13th. An amazing result for our first attempt!

After the challenge, some of us went to find a beach, others went to Ferrari world.  All too soon, it was back over to the exhibition centre to pack up the crate, load up our suitcases with batteries and everything else and then off to bed for another early start as the bus to the airport was booked for 6:15am. The journey back was spent sleeping on the plane, and talking about what went well and what we could do better on the train back to Leeds.

This was a really exciting project to take part in, a steep learning curve for me with the reward of visiting a new country, taking part in an challenging competition and getting to know and work with an amazing group of people. Thanks to everyone who helped make it happen and to the team for making the whole experience one I’ll remember happily for a very long time.

Goodbye Abu Dhabi.
Goodbye Abu Dhabi.

Links

There was lots of videos and social media content generated.  Here are some links to content that has our team in it somewhere.

Youtube videos

First Real Robotics Video for MBZIRC

Social media

https://www.facebook.com/mbzirc
https://twitter.com/hashtag/MBZIRC2020

Official highlight videos

KU MBZIRC – The Arrival of the world’s top robotics research teams to #MBZIRC2020

KU MBZIRC – WELCOME VIDEO at Day one

KU MBZIRC – #MBZIRC2020 TEAM from University of Leeds

KU MBZIRC – First Day of Rehearsals at #MBZIRC2020

Highlights of final day rehearsals at #MBZIRC2020

KU – MBZIRC Highlights of Day 2 of fun and fierce on at #MBZIRC2020

KU MBZIRC – Highlights of Day 2 at #MBZIRC2020

KU – MBZIRC Wrap up of #MBZIRC2020 Final Day

Official media pages

There are lots of photos and videos.  Just click around to see them.

http://www.mbzirc.com/photo-album

http://www.mbzirc.com/video-album

Summary video

Mohamed bin Zayed International Robotics Challenge 2020

Team Playlist

https://www.youtube.com/playlist?list=PLzFXth6b-sVXD94e0R4bOeukPkQ_BNp_K

Prequel videos

MBZIRC – University of Leeds – List of Members

KU MBZIRC – University of Leeds Team preparations for #MBZRIC2020