Can I run multiple integration tests with one single config file in Flutter?

Question

I am trying to write Flutter integration tests and to run them all with one config file instead of making config file for every single test. Is there any way to do that?

For now I have login.dart and login_test.dart and so on, for every single test. I know its convention that every config and test file must have the same name, but that's not what I need, more configurable things are welcomed. Thanks in advance.

This is my config file (login.dart)

import 'package:flutter_driver/driver_extension.dart';
import 'package:seve/main.dart' as app;

void main() {
enableFlutterDriverExtension();
app.main();
}

And test (login_test.dart) looks something like this

import ...

FlutterDriver driver;

void main() {

setUpAll(() async {
driver = await FlutterDriver.connect();
});

tearDownAll(() async {
if (driver != null) {
  driver.close();
}
});

test('T001loginAsDriverAndVerifyThatDriverIsLogedInTest', () async {
  some_code...
});
});

Now I want to make new test file (e.g login_warning.dart) and be able to start both tests by calling single config file (login.dart). Is that even possible?

Solution 1

Yes, running multiple "test" files with the same "config" is possible.

In the flutter jargon, your config file is your target and your test file is your driver. Your target is always login.dart but you have the two drivers login_test.dart and login_warning.dart.

With the flutter drive command, you can specify the target as well as the driver.

So in order to run both drivers, simply execute the following commands

flutter drive --target=test_driver/login.dart --driver=test_driver/login_test.dart
flutter drive --target=test_driver/login.dart --driver=test_driver/login_warning.dart

This executes first the login_test.dart and then the login_warning.dart driver.

Solution 2

You can always have one main test file that you initiate, like say

flutter drive --target=test_driver/app_test.dart

Then in that call your test groups as functions, like so -

void main() {
  test1();
}
void test1() {
  group('test 1', () {});}

So with one command you get to execute all the cases mentioned in the main()

Solution 3

Like vzurd's answer my favourit and cleanest is to create a single test file and call all main methods from within:

import './first_test.dart' as first;
import './second_test.dart' as second;

void main() {
  first.main();
  second.main();
}

Then just run driver on the single test file:

flutter drive --driver=test/integration/integration_test_driver.dart --target=test/integration/run_all_test.dart

Solution 4

to expand on to @sceee 's answer:

you can put the multiple commands into a shell script named integration_tests.sh for example and run them with a single command that way.

#!/bin/sh

flutter drive --target=test_driver/app.dart --driver=test_driver/app_test.dart
flutter drive --target=test_driver/app.dart --driver=test_driver/start_screen_test.dar 

make executable:
$chmod a+rx integration_tests.sh
run it:
$./integration_tests.sh

View more solutions

Comments

[XorX]

Thats sad... and ugly. But yes, it's the only solution.

[E. Sun]

This doesn't reset the state between two tests

[Dennis Barzanoff]

This doesn't work