Belajar QA Tester - Test Evidence & Audit

#Pendahuluan

Setelah di episode 19 kita mempelajari secure test environments, pada episode ini kita mempelajari test evidence & audit — bagaimana mendokumentasikan test evidence untuk compliance dan audit. Di industri regulated seperti banking, healthcare, dan finance, test evidence adalah legal requirement.

Mengapa test evidence & audit penting? Karena tanpa dokumentasi yang proper, kalian tidak bisa membuktikan bahwa testing dilakukan dengan benar. Audit bisa terjadi kapan saja dan kalian harus siap menunjukkan evidence.

#Test Evidence

#Jenis Evidence

text

Test Evidence:
├── Test Cases:
│   ├── Written test cases
│   ├── Expected results
│   └── Actual results
├── Test Results:
│   ├── Pass/Fail status
│   ├── Execution date
│   └── Tester name
├── Bug Reports:
│   ├── Bug descriptions
│   ├── Screenshots/video
│   └── Resolution status
├── Test Reports:
│   ├── Summary report
│   ├── Coverage metrics
│   └── Risk assessment
└── Artifacts:
    ├── Screenshots
    ├── Video recordings
    ├── Log files
    └── Environment details

#Contoh Test Report

yaml

test_report:
  title: "Test Report - Sprint 5"
  date: "2026-08-16"
  tester: "QA Team"
  summary:
    total_test_cases: 150
    executed: 150
    passed: 145
    failed: 5
    pass_rate: "96.7%"
  coverage:
    functional: "100%"
    regression: "100%"
    exploratory: "80%"
  defects:
    total: 10
    critical: 0
    high: 2
    medium: 5
    low: 3
    open: 2
    closed: 8
  risk_assessment:
    level: "Low"
    notes: "All critical paths tested, no P1 bugs"
  environment:
    browser: "Chrome 120"
    os: "Windows 11"
    app_version: "2.1.0"
  conclusion: "Release recommended"

#Audit Trail

#Apa itu Audit Trail?

Audit trail adalah catatan lengkap semua aktivitas testing:

text

Audit Trail:
├── Who: Siapa yang melakukan testing
├── What: Test apa yang dijalankan
├── When: Kapan testing dilakukan
├── Where: Di environment mana
├── How: Bagaimana testing dilakukan
└── Result: Apa hasilnya

#Contoh Audit Trail

Timestamp	Action	User	Result	Notes
2026-08-16 09:00	Login test	QA-1	Pass	All scenarios
2026-08-16 09:30	Payment test	QA-1	Fail	BUG-001
2026-08-16 10:00	Regression	QA-2	Pass	All fixed

Note

Audit trail harus otomatis dan tidak bisa di-modify manual. Gunakan tools test management seperti TestRail atau Zephyr untuk generate audit trail secara otomatis.

#Compliance Requirements

#Compliance Checklist

text

Compliance Checklist:
├── Documentation:
│   ├── Test plan tersedia
│   ├── Test cases terdokumentasi
│   ├── Test results tercatat
│   └── Bug reports lengkap
├── Traceability:
│   ├── Requirement → Test case
│   ├── Test case → Test result
│   ├── Bug → Test case
│   └── Requirement → Bug
├── Approval:
│   ├── Test plan approved
│   ├── Test results reviewed
│   ├── Release approved
│   └── Sign-off documented
└── Retention:
    ├── Evidence disimpan
    ├── Retention period ditentukan
    └── Backup tersedia

#Practical: Evidence Management

#Tools untuk Evidence

text

Evidence Management Tools:
├── TestRail:
│   ├── Test cases & results
│   ├── Reports & dashboards
│   └── Audit trail
├── Jira + Zephyr:
│   ├── Bug tracking
│   ├── Test execution
│   └── Reports
├── Confluence:
│   ├── Test documentation
│   ├── Test plans
│   └── Meeting notes
└── S3/Cloud Storage:
    ├── Screenshots
    ├── Video recordings
    └── Log files

Tip

Automate evidence collection sebanyak mungkin. Screenshots otomatis, video recordings saat test execution, dan logs yang tercentrasi. Ini mengurangi waktu manual dan meningkatkan konsistensi.

#Penutup

Pada episode 20 ini, kalian telah mempelajari test evidence & audit.

Inti yang harus dibawa pulang:

Test evidence harus lengkap: test cases, results, bug reports, test reports.
Audit trail harus otomatis dan tidak bisa di-modify.
Compliance membutuhkan traceability dari requirement hingga test result.
Evidence management harus terstruktur dan accessible.

Di episode 21 selanjutnya, kita akan membahas AI-assisted manual testing — bagaimana menggunakan AI untuk membantu aktivitas testing manual. Sampai jumpa di episode 21!