ci: build the e2e virtualenv once per worker and re-enable test-vscode-e2e

[tripleaceme]

Description

Closes #6071. Builds the test virtualenv once per worker, as agreed on the issue, and turns test-vscode-e2e back on.

Build the virtualenv once per worker

fixtures.ts gains a worker-scoped sharedPythonEnvironment alongside the existing sharedCodeServer. It creates its own directory, installs sqlmesh[lsp,bigquery] plus custom_materializations once, and warms the import. It is not auto, so only tests that ask for it pay for it.

Measured cost that is now paid once per worker rather than once per test:

step	cost
uv venv	0.3s
uv pip install -e repo[lsp,bigquery] + custom materializations	18.4s
first import sqlmesh.lsp.main	25.3s

That second figure was not in the diagnosis I posted on the issue, and it is the larger half — Python compiling the dependency tree into __pycache__, inside the LSP handshake the tests wait on. Sharing the virtualenv without warming the import barely moved the needle, so the warm-up is doing as much work here as the install.

Converted: all 3 in configuration.spec.ts, and the 2 environment-injection tests in python_env.spec.ts.

Deliberately not converted, because their own virtualenv is the thing under test: venv_naming.spec.ts (the venv's name is the assertion), tcloud.spec.ts and python_env.spec.ts's tcloud cases (they install a mock tcloud, which in a shared environment would leak into every later test in the worker), and bad_setup.spec.ts (installs without the lsp extra on purpose).

Re-enable the job

Same path filter as the unit job, so Python-only pull requests are not gated on it.

code-server is pinned instead of installed from latest. That was not the cause of the failures — the render selector broke identically on 4.107.1, the newest release when the job was disabled — but leaving it unpinned means the next editor UI change arrives as a mystery failure rather than a visible version bump.

The timeout, and where I would push back on my own change

The per-test timeout goes from 60s to 180s, and I want to be straight that this is the weakest part of the PR.

Removing ~44s of fixed cost was not enough on its own:

	at 60s
before	0 of 7 passed
after	1 of 7 passed

At 240s after the change, 9 passed, 0 failed. The per-test durations show why: the first test a worker runs costs 2.5–4.0 minutes; every later test in that worker costs 21–39 seconds. configuration.spec.ts tests 2 and 3 went from timing out to 29–31s, which is the fixture working exactly as intended. The residual is the editor and extension host starting cold on the worker's first page load, which no virtualenv fixture removes.

180s is chosen against measurements from a machine roughly twice as slow as ubuntu-2204-8, and under desktop load. It is the number most worth revisiting once there is real CI data — the first green run on the runner is the only measurement that really counts here, and I would rather set it from that than from my laptop.

One behaviour worth knowing: a test timeout restarts the worker, which destroys the worker fixture and rebuilds the virtualenv for the next test. One slow test therefore makes a whole file look broken. That is an argument for retries staying on.

Test Plan

pnpm run lint                    # ui-style: prettier + eslint + tsc, all workspaces
pnpm run ci (vscode/extension)   # test-vscode: eslint, tsc --noEmit, vitest — 19 tests
pnpm exec playwright test tests/configuration.spec.ts tests/python_env.spec.ts

All numbers above are macOS on a 4-core laptop against code-server 4.137.0 at --workers=2 --retries=0. Nothing here has been run on Linux or on the actual runner.

Checklist

• I have run make style and fixed any issues
• I have added tests for my changes (if applicable)
• All existing tests pass (make fast-test)
• My commits are signed off (git commit -s) per the DCO

[cmgoffena13]

We'll also want to run this if any files under sqlmesh/lsp/** have run. Any changes to the language server should trigger this pipeline as well

[tripleaceme]

Done in d91489e. I added an lsp paths filter for sqlmesh/lsp/** and included it in the test-vscode-e2e condition. I left test-vscode as it is, since its unit tests don't start the language server. Happy to add it there too if you'd like.

[cmgoffena13]

I don't think we have access to this runner anymore, can you switch this to ubuntu-latest and we can see if it will work?

[cmgoffena13]

You might be able to assign ubuntu-latest-8-cores and we can see if we have that, but I'm dubious

[tripleaceme]

Switched to ubuntu-latest in d91489e. If it turns out to be too slow there, I can try ubuntu-latest-8-cores.