Trivago Aggressively Monitors to Reduce Software Test Flakiness

2 years ago thenewstack.io

Summary: This is a summary of an article originally published by The New Stack. Read the full original article here →

Test flakiness is one of the main challenges with automated testing. It happens when test failures are triggered by issues unrelated to the application being tested.

A centralized test report server monitors processes, offering one-click linking to test reports, and alerting that notifies QA engineers and developers when tests fail for multiple URLs. Trivago iterated its Elasticsearch, Kilbana and Selenium (ELK) stack with two goals in mind: to better identify the cause of end-to-end testing failures and, more specifically, to eliminate test flakiness.

Grafana: https://thenewstack.io/grafana-after-9-years-what-now/ is used to scan for flakiness in testing overnight on the main application branch by counting base URLs.

DevOps Articles