Repository navigation
docs(compat): a ranked plan of the next compatibility tests, from widget use in the Flutter sample apps - #759
Merged
Merged
Conversation
…get use in the Flutter sample apps
… dialog stays matched, and a Flutter field's text has no store verb
jay23606
added a commit
to jay23606/flutter-probe
that referenced
this pull request
Nov 17, 2026
…get use in the Flutter sample apps (AlphaWaveSystems#759) ## Summary This PR adds `docs/compat/NEXT.md`, a ranked plan of the compatibility tests to write next, and `docs/compat/widget-usage.py`, the count behind it. Documentation only: no matrix cell changes, and nothing in it claims how FlutterProbe behaves with a widget. - **Ranking.** For each widget in `catalog.json` (Flutter 3.50.0), the script counts how many of the 36 packages of `flutter/samples` construct it. The commit is pinned to `12a1916` (2026-11-11). Tests, generated files and comments are excluded. Layout-only widgets are excluded, apart from the ones that change what `see` or `tap` mean. - **The 11 items.** `Text`, then the app bar and routes, widgets without text, scrolling lists, tiles, progress indicators, gestures, dialogs, snack bars, the Cupertino bars and overlapping widgets. Each item names: - the fixture screen (`PROBE_FIXTURE_WIDGETS=<family>`); - the ProbeScript steps, all of which exist in the grammar today. The one follow-up that needs a missing verb (`store text of` a Flutter widget) says so; - the variants that must fail; - the open question the test settles. - **Two open questions worth naming:** - The route rule on a device. The agent does not match a route under an opaque one, and an agent unit test covers that (`probe_agent/test/finder_test.dart`, PT-03). Under a dialog, popup or sheet the page stays matched by design. What is open is a device run. - Does a lazy list's unbuilt row count as absent? - **Also listed:** - the follow-ups for the cells the matrix marks "partly"; - the families the source cannot rank (pickers, menus, tabs, drawers, sheets are rare in demo apps), without a usage claim; - the limits of the method. - `docs/compat/README.md` lists the two files, and the CHANGELOG has the entry. The newest stable Flutter in the official release manifest is still 3.50.0 (Dart 3.14.0, 2026-11-11), which `RELEASES.md` already records. Nothing to add there. ## Test plan - [x] The committed script, run on the same checkout, gives output byte-identical to the run the ranking was taken from (36 packages, 185 widgets used). - [x] Every step form named in the plan exists in `website/src/content/docs/probescript/grammar.md` or in an existing suite. - [x] The newest stable release was checked against the official manifest.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds
docs/compat/NEXT.md, a ranked plan of the compatibility tests to write next, anddocs/compat/widget-usage.py, the count behind it. Documentation only: no matrix cell changes, and nothing in it claims how FlutterProbe behaves with a widget.catalog.json(Flutter 3.50.0), the script counts how many of the 36 packages offlutter/samplesconstruct it. The commit is pinned to12a1916(2026-11-11). Tests, generated files and comments are excluded. Layout-only widgets are excluded, apart from the ones that change whatseeortapmean.Text, then the app bar and routes, widgets without text, scrolling lists, tiles, progress indicators, gestures, dialogs, snack bars, the Cupertino bars and overlapping widgets. Each item names:PROBE_FIXTURE_WIDGETS=<family>);store text ofa Flutter widget) says so;probe_agent/test/finder_test.dart, PT-03). Under a dialog, popup or sheet the page stays matched by design. What is open is a device run.docs/compat/README.mdlists the two files, and the CHANGELOG has the entry.The newest stable Flutter in the official release manifest is still 3.50.0 (Dart 3.14.0, 2026-11-11), which
RELEASES.mdalready records. Nothing to add there.Test plan
website/src/content/docs/probescript/grammar.mdor in an existing suite.