Yeah, LLVM is used to query some information for the semantic phase.
The most trivial option to remove the dependency on libllvm_ext is to install LLVM version 18 or more. The extension lib is only necessary for older versions.
For older versions you can run make deps in the compiler source tree.