Ejecutar pruebas de IU en acciones de GitHub
Seguimos ocupándonos de la automatización de un proyecto de Android en Acciones de GitHub, en esta parte:
Comencemos un nuevo proyecto para pruebas de IU en Firebase Test Lab
Configurar la integración de acciones de GitHub y Test Lab
Veamos cómo puede ejecutar pruebas de IU en un flujo de trabajo en CI / CD.
Si te perdiste la primera parte de la historia, que trata sobre las pruebas unitarias en un proyecto de Android, puedes empezar con ella.
Para ejecutar pruebas unitarias, solo necesitamos tener un entorno Java configurado. Todas las pruebas pasan muy rápido dentro de la JVM, todo es simple y la situación de pruebas flacky está casi excluida. Tales pruebas deben ser del 70 al 80% del número total de pruebas en el proyecto, en primer lugar , vale la pena cubrir la lógica comercial con ellas.
Pero a veces quieres más: pruebas que simularán las acciones de usuarios reales y compararán las expectativas con la realidad.
UI- . -, . , . , UI- , , /- . , - - . , .
Firebase Test Lab - Google, . 10 5 . 1$ - , .
Test Lab :
checkout Java-
unit-. , UI-.
Gradle- UI-
APK-, .
Firebase Test Lab .
command line gcloud, Test Lab APK.
, , workflow GitHub Actions.
Firebase GitHub.
https://console.firebase.google.com Google-.
, .
Google- , Test Lab . , .
, GitHub Actions Test Lab.
“ ” (“Project settings”), “ ” (“Service accounts”). “ ” (“Manage service account permissions”).
, CI/CD GitHub Actions. UI- “”. .
“”. , Firebase 403.
ERROR: (gcloud.firebase.test.android.run) Unable to access the test environment catalog: ResponseError 403: Not authorized for project ***
“”
CI/CD . “ ” (“Create key”).
JSON, . , , - . private_key.
, JSON . Base64.
:
1)
base64 github-actions-sample-key.json > base64-key.txt
github-actions-sample-key.json - JSON, base64-key – , .
2) https://www.base64encode.org/
GitHub Secrets GitHub.
Firebase base64-key.
Project ID Firebase. Project number.
, GitHub Actions Test Lab. workflow giithub/workflows.
workflow, UI- Test Lab .
ERROR: (gcloud.firebase.test.android.run) User [github-actions-ci-cd@***.iam.gserviceaccount.com] does not have permission to access project [***:initializeSettings] (or it may not exist): Cloud Tool Results API has not been used in project 254361894337 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/toolresults.googleapis.com/overview?project=254361894337 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry.
- API toolresults.googleapis.com, , API . “Enable APIs and services”.
API . Cloud Tool Result API .
- , workflow.
name: UI_tests_on_release
on:
pull_request:
branches:
- 'main'
jobs:
assemble_ui_test_artifacts:
if: startsWith(github.head_ref, 'release/') == true
name: Build artifacts
runs-on: ubuntu-20.04
steps:
- uses: actions/checkout@v2
- uses: actions/setup-java@v1
with: {java-version: 1.8}
- name: Build APK for UI test after Unit tests
run: |
./gradlew test
./gradlew assembleDebug
./gradlew assembleDebugAndroidTest
- name: Upload app-debug APK
uses: actions/upload-artifact@v2
with:
name: app-debug
path: app/build/outputs/apk/debug/app-debug.apk
- name: Upload app-debug-androidTest APK
uses: actions/upload-artifact@v2
with:
name: app-debug-androidTest
path: app/build/outputs/apk/androidTest/debug/app-debug-androidTest.apk
run_ui_tests_on_firebase:
runs-on: ubuntu-20.04
needs: assemble_ui_test_artifacts
steps:
- uses: actions/checkout@v2
- name: Download app-debug APK
uses: actions/download-artifact@v1
with:
name: app-debug
- name: Download app-debug-androidTest APK
uses: actions/download-artifact@v1
with:
name: app-debug-androidTest
- name: Firebase auth with gcloud
uses: google-github-actions/setup-gcloud@master
with:
version: '290.0.1'
service_account_key: ${{ secrets.FIREBASE_KEY }}
project_id: ${{ secrets.FIREBASE_PROJECT_ID }}
- name: Run Instrumentation Tests in Firebase Test Lab
run: |
gcloud firebase test android models list
gcloud firebase test android run --type instrumentation --use-orchestrator --app app-debug/app-debug.apk --test app-debug-androidTest/app-debug-androidTest.apk --device model=Pixel2,version=28,locale=en,orientation=portrait
,
1
name: UI_tests_on_release
on:
pull_request:
branches:
- 'main'
jobs:
assemble_ui_test_artifacts:
if: startsWith(github.head_ref, 'release/') == true
name: Build artifacts
runs-on: ubuntu-20.04
steps:
- uses: actions/checkout@v2
- uses: actions/setup-java@v1
with: {java-version: 1.8}
workflow, . Pull request main , release/.
checkout Java 8.
2
- name: Build APK for UI test after Unit tests
run: |
./gradlew test
./gradlew assembleDebug
./gradlew assembleDebugAndroidTest
- name: Upload app-debug APK
uses: actions/upload-artifact@v2
with:
name: app-debug
path: app/build/outputs/apk/debug/app-debug.apk
- name: Upload app-debug-androidTest APK
uses: actions/upload-artifact@v2
with:
name: app-debug-androidTest
path: app/build/outputs/apk/androidTest/debug/app-debug-androidTest.apk
unit- APK - app-debug.apk app-debug-androidTest.apk. ? APK - , APK instrumentation-, .
upload-artifact@v2.
3
run_ui_tests_on_firebase:
runs-on: ubuntu-20.04
needs: assemble_ui_test_artifacts
steps:
- uses: actions/checkout@v2
- name: Download app-debug APK
uses: actions/download-artifact@v1
with:
name: app-debug
- name: Download app-debug-androidTest APK
uses: actions/download-artifact@v1
with:
name: app-debug-androidTest
Job workflow (assemble_ui_test_artifacts), , .
.
needs: assemble_ui_test_artifacts
action download-artifact@v1 APK Job.
4
- Test Lab .
- name: Firebase auth with gcloud
uses: google-github-actions/setup-gcloud@master
with:
version: '290.0.1'
service_account_key: ${{ secrets.FIREBASE_KEY }}
project_id: ${{ secrets.FIREBASE_PROJECT_ID }}
- name: Run Instrumentation Tests in Firebase Test Lab
run: |
gcloud firebase test android models list
gcloud firebase test android run --type instrumentation --use-orchestrator --app app-debug/app-debug.apk --test app-debug-androidTest/app-debug-androidTest.apk --device model=Pixel2,version=28,locale=en,orientation=portrait
action setup-gcloud, ID Base64 , , .
.
gcloud firebase test android models list SDK. , .
workflow , .
, , UI- ! Test Lab . Project ID ( ID) .
orchestrator, --use-orchestrator.
UI- , .
--num-flaky-test-attempts - Flaky .
--network-profile - . , .
:
https://cloud.google.com/sdk/gcloud/reference/firebase/test/android/run
https://firebase.google.com/docs/test-lab/android/instrumentation-test#sharding
https://github.com/Flank/flank
- :
1) UI- Test Lab , MacOS. https://github.com/ReactiveCircus/android-emulator-runner
2) UI-. Android SDK .
UI- GitHub Actions :)