The Tests AMD / CI image checks / MyPy checks (mypy-providers) (pull_request) is failure has nothing to do with this PR.

Thanks for the PR. Code looks good but in details it fails in "complexity" in which order the modules are loaded. I assume you rather need to set config in a try/catch not via if.

I'm not sure an if statement would help in this case, since all configuration values from provider.yaml are loaded via the @providers_configuration_loaded decorator, and core.execution_api_server_url isn't among them.

That’s why edge.api_url doesn’t fail here:

There’s also a scenario where the user explicitly sets core.execution_api_server_url, but we override it early on in force_use_internal_api_on_edge_worker, before it’s even evaluated.

So in my opinion, this comes down to an implementation decision:
Do we really need to support both core.execution_api_server_url and edge.api_url in this provider, or can we simplify by assuming only edge.api_url will be used consistently?

@jscheffl Another alternative would be to insert the logic in worker.py directly.

@jscheffl Another alternative would be to insert the logic in worker.py directly.

airflow/providers/edge3/src/airflow/providers/edge3/cli/worker.py

Line 171 in 460b1c6

def _launch_job_af3(self, edge_job: EdgeJobFetched) -> tuple[Process, Path]:

Yeah you are right. Implementation decision. Such hard thoughts needed. I agree the chicken egg is existing.

I assume there will be cases in the future where you might want to separate API server from task SDK API. Therefore I always kept it separate. The edge.api_url is for the provider just to to distribute the job and the core.execution_api_server_url is used by the task runner from task SDK. I would prefer to keep it separate for the moment.

Actually the idea to inject in _launch_job_af3() sounds liek a very good idea because (1) then it is just filling the gap on the point where needed (and not global) as well as removes the config loading problem at time of bootstrap!

@jscheffl I moved the implementation code to worker.py and added some tests.

As you made WIP commits, converting the PR to "Draft". Let me know if I should re-review.

Ready for review.