QuestionQ179
Validation TestingA Machine Learning Engineer uses an MLOps process with continuous integration to deploy and promote models into production. However, the process contains no automated tests. This has resulted in many errors and low-quality models being deployed to production, causing negative business outcomes. The company has three environments: development, staging, and production.
The engineer now wants to add unit and integration testing to the existing MLOps process to reduce the number of errors and poorly performing models that reach production. The tests must not slow experimentation, must identify potential problems as early as possible, and must run automatically.
At what point in the deployment pipeline should the CI/CD process automatically run unit and integration tests to meet these requirements?
- A Upon submitting a pull request to the staging environment, automatically execute the integration tests. Users are responsible for executing the unit tests before submitting the pull request.
- B Upon submitting a pull request to the staging environment, automatically execute the unit tests. Configure the integration tests to automatically run against the staging environment once daily.
- C Upon submitting a pull request to the staging environment, automatically execute the unit tests followed by the integration tests.
- D Upon submitting a pull request to the production environment, automatically execute the unit tests. Configure the integration tests to run after the new code is deployed to the production environment.
Community Discussion