Large language models promise more efficiency in software development. But, despite all the promises, there are still a few things to consider when using them.