- Home
- Case Studies
- QA for AI powered Media Marketplace
Jul 04, 2023 3 min read
QA for AI powered Media Marketplace
Platforms:
WebCountry:
SingaporeImplementation time:
Aug 2021 – Present
about company
It is one of the leading worldwide Microstock marketplaces for video makers internationally. The vibrant marketplace offers everything from stock videos, music, 3D models, After Effects, and Apple Motion templates bundled with transparent, royalty-free licensing.
For this project, Luxe Quality provided skilled Backend QA, Manual QA, and Automation QA / Team Lead. We strived to achieve maximum test coverage through automated testing, which was crucial in verifying the software system's functionality, performance, and reliability. By aiming for complete test coverage, we ensured that all critical scenarios and edge cases were thoroughly tested, reducing the risk of potential issues or regressions.
before
When we started working on this project, there were nearly 100 E2E tests, which took 1 hour to execute, and 200 Postman + Newman smoke tests for implementing API tests. There was no documentation on the project, and the test coverage was unknown.
Our task was to update the backend and frontend test frameworks for the client's project.
challenges and solutions
Challenges | Solutions |
|---|---|
Unknown coverage: probably less than 10% | Developed 2000 E2E automation tests with Allure reports, achieving almost 90% functionality test coverage |
Execution time: nearly 100 E2E tests took 1 hour to execute | Optimized tests and created standard methods, reducing the test execution time to approximately 30 minutes. Even though the number of cases has increased significantly |
Diverse testing requirements: needed to test front and backend | Utilized specific tools and methodologies, such as Postman and Runscope (BlazeMeter), to conduct API and contract testing for the backend. Developed test plans and checklists for frontend testing. Employed a combination of manual and automated testing to cover all testing requirements. Manual Testing: Functional, Usability, Accessibility, Regression, Security, E2E. AutomationTesting: Functional, |
No documentation | Created specific level test plans, checklists, and more than 1000 bug reports to document the testing process. Also, set up reporting after tests |
Unclear test results without a reporting system | Implemented a reporting system to generate clear and concise test reports. Test results were documented and shared with the project manager to inform them of progress and enable better decision-making |
Ensuring continuous improvement and adherence to standards | Introduced testing standards and best practices, such as Code freeze for release stability and standardized bug reporting. Conducted regular assessments and evaluations of the testing process to identify areas for improvement. Implemented state monitoring and focused on continuous learning and development within the QA team |
technologies, tools, approaches
The project utilized various technologies, including Webdriver.io, Postman, Burp Suite, Runscope, GitHub Actions, Allure Reporter, OpenAPI, CIrcleCI, AWS S3, GTM, Qase, and Jira. We also established Code Freeze for Release Stability, Standards for Bug Reports, and Testing Standards and focused on continuous improvement.
The implementation of these practices has had a positive impact on various aspects of application quality and user experience. Code freezes have provided a stable foundation for releases, reducing the risk of introducing new issues and ensuring excellent stability.
features of the project
The involvement of QA Engineers in requirements and development was a critical aspect of the project. Another significant aspect was the complete migration to a new backend and frontend framework. For this project, we also implemented TestOps.
results
- Migration to the latest technologies went smoothly and seamlessly. Users reported minimal issues on production. Any arising problems were mainly related to some extra or individual cases. The customer's requirements were effectively fulfilled, and the project received ongoing support.
- We had 2200 TMS test cases throughout our active collaboration covering all application roles. These cases were accompanied by 2000 E2E tests with an Allure report, deployed on the server, and saved in history. Test execution now takes nearly 30 min. We also have 1700 E2E API tests with contract testing.
- Code freezes provide a stable foundation for releases, minimizing the risk of introducing new issues. Implementing standardized bug reports improved communication between testers and developers, leading to faster bug resolution.
Adherence to testing standards facilitated a comprehensive and consistent approach to testing, ultimately enhancing the overall software quality. We implemented the best practices of QA to this project for testing and decreasing development risks. The application was successfully released.
Implementation Steps
User Stories Testing
Communication with Developers and Preparing Test Data
Develop a Proof of Concept (POC) and Present it to the Client and Stakeholders
Migrate to a New Testing Framework
Writing the First 300 Tests for the Highest-Priority Functionality
Generate a Report on the Coverage Achieved by Manual and Automated Tests
Performing Various Types of Testing with the Functionality That Was Developed
- Functional Testing
- Non-Functional Testing, such as Security, Usability, and Accessibility Testing
- Black-Box Testing and White-Box Testing,
- Acceptance and Regression Testing
- End-to-End (E2E) Testing,
- API Testing,
- Automation Testing
SEO Checks: Evaluating the application's adherence to search engine optimization best practices to improve its visibility and ranking in search engine results.
Our team helped ensure the system functions correctly, met requirements, performed well, and provided a secure and user-friendly experience. Once the setup was completed, we conducted re-tests and regression testing every sprint (2 weeks). Additionally, we provided testing reports to the project manager to keep them informed of our progress.
client's feedback
To read the client's review for this project, click here.
- Manual testing
- Regression testing
- Functional testing
- Automation testing
- Usability testing
- Accessibility testing
- Security testing
- API testing
Looking for reliable Software Testing company?
Let's make a quality product! Tell us about your project, and we will prepare an individual solution.
Other Projects
Pulse Prospector
USA
•Web
Implementation time:
February 2023 - Present
About project:
The Pulse Prospector platform is a lead-generation tool for sales, marketing, and business development teams.
Services:
Manual usability testing and automated smoke and regression testing.
Result:
800+ bug reports resolved, 300 manual and automated tests conducted, 50% faster deployment cyclesFULL CASE STUDY
Vitassist
Italy
•Web, Mobile
Implementation time:
Jun 2023- Nov 2023
About project:
Vitassist is an online platform for Italian healthcare.
Services:
Manual and Automation, Functional, UI/UX, Regression, Security, API, Database Testing
Automated - WebdriverIO + JavaScript
Result:
220 created test cases provided, and 189 automatedFULL CASE STUDY
EduSparkle
Canada
•Web
Implementation time:
Now 2023 - present
About project:
EduSparkle offers interactive language and science learning platforms that make learning fun and effective.
Services:
Manual, Automation testing, QA architect, PM
Automated testing - JavaScript + Cypress + TestCafe and Python
Result:
200 test cases automated to cover critical features based on user needs.FULL CASE STUDY