Yes, in general any generic ledger tooling (all daml ledger commands, daml script, triggers, json api, …) always talks to the ledger API port. Only once you get to the Canton console or other canton specific stuff do you have to worry about the other ports.