The last time I significantly touched cloudformation I was using JSON nevertheless a custom made template processor (do not laugh we all do it at some issue). Workers are deployed directly employing the AWS API. If its a new lambda, its deployed into AWS and the controller lambda has its environment variables update to know about the new lambda, at which place new lookups will hit it and the index grows.