Regression Testing Framework for SaaS Forms

EmailMeForm is a SaaS platform that allows organizations to create online forms and surveys used for registrations, customer feedback, applications, and data collection.

Over time, thousands of forms were created by customers using different combinations of fields, layouts, fonts, and styles. As the platform evolved with new features and updates, ensuring that existing forms continued to render and function correctly became increasingly challenging.

Maintaining backward compatibility for previously created forms was critical to preserving customer trust and ensuring that updates to the platform did not disrupt existing workflows.

1. As the platform evolved with new features and improvements, software updates occasionally introduced unintended changes to existing forms created by customers.
2. These issues ranged from visual inconsistencies such as altered layouts, spacing, or fonts to functional regressions affecting validation rules, conditional logic, and form submission behavior.
3. Testing these scenarios manually required QA engineers to validate hundreds of form configurations across multiple browsers and environments. The growing number of possible combinations made manual regression testing inefficient and slowed down release cycles.
4. The client required an automated system capable of validating both visual rendering and functional behavior of forms to ensure product updates did not break previously created forms.
5. Key challenges included:
6. • Visual drift – Layout, fonts, spacing, and styling occasionally changed after platform updates.
7. • Functional regressions – Validation rules, conditional logic, and submission workflows sometimes stopped working correctly.
8. • Large configuration variety – Thousands of customer forms used different combinations of fields, layouts, and styles.
9. • Manual regression testing – QA engineers had to manually validate many form configurations before each release.
10. • Slower release cycles – Manual testing significantly delayed deployment of new platform features.

Scimus developed a comprehensive automated regression testing framework specifically designed for the form builder platform.

The project began with the creation of a large internal library of test forms representing hundreds of possible combinations of form configurations. These forms included variations of field types, layouts, fonts, styles, validation rules, and conditional logic.

For visual regression testing, the framework generated DOM snapshots of each form created using the current production version of the platform. These snapshots served as baseline references.

Whenever a new version of the form builder was introduced, the system automatically regenerated the same set of forms and captured new DOM snapshots. Automated DOM comparison tools analyzed differences between the baseline and new versions to detect visual changes.

If differences exceeded predefined thresholds, the framework flagged them for investigation and generated detailed reports for the QA team.

To validate functional behavior, the system also executed automated Selenium test cases simulating real user interactions with the forms, including:

A duly-designed — meaning cost-efficient and result-oriented — team was assigned to the project.