Testing with Real Robots over the Internet: What Could Go Wrong? - Jason Huggins, Selenium

Testing with Real Robots over the Internet: What Could Go Wrong? - Jason Huggins, Selenium

When I started the Selenium project, I'd frequently describe Selenium as "like a robot" that is trapped inside your computer. For the past 11+ years, I've been testing that metaphor by building real mechanical robots for testing apps and devices, pushing the definition of "end" in end-to-end testing. Lately, I've been remotely controlling these robot over the internet, and learned some lessons I'd like to share. In this talk, I'll compare and contrast how testing with a physical robot over the internet is different than traditional testing approaches with Selenium or Appium.
Outline/Structure

Overview of telerobotics and telepresence
Why test with physical robots vs traditional approaches
How testing with physical robots is different
Motors
Sensors
Cameras
Object locator strategies:
"Traditional" approaches with OpenCV
"AI" approaches with machine learning
Challenges of testing with robots
Lighting
Latency
Mechanical wear and tear
Skills required
"Does it scale?"
Future work

Learning Outcome

Understanding of the costs, benefits, challenges, and opportunities of testing with robots.
Target Audience
All
Prerequisites for Attendees

Attendees should have a general interest in mobile testing and robots.
Links

Keynote - Don't Fear The Robot by Jason Huggins | AppiumConf Bengaluru 2019

Appium: The Untold Story - Dan Cuellar & Jason Huggins | AppiumConf London 2018

Robots: The Nuclear Option | SeleniumConf London 2016

Fixing HealthCare.gov, One Test at a Time | Selenium Meetup San Francisco 2015

World Domination: Next Steps | SeleniumConf Portland 2015

Teaching a Robot to Play Angry Birds | SeleniumConf London 2012

Selenium automates browsers. That's it! What you do with that power is entirely up to you. Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should) also be automated as well. For more infomation check out: https://www.selenium.dev/

Видео Testing with Real Robots over the Internet: What Could Go Wrong? - Jason Huggins, Selenium канала Selenium Conference