How has AI impacted developers’ tools? Why is it dangerous to uncritically trust the AI-produced code, and what is the new type of security threat called prompt injection? Top experts from Microsoft, JetBrains, and DataArt delved into the boundaries and potential of LLMs and shared insights on what these leading companies have in store for us shortly.
At this year’s DataArt’s NonStop Conference, we discussed how enterprises and developers can use GenAI to make processes faster and less expensive. One of the first sessions was a moderated panel discussion regarding the influence of AI on tools and what we can expect in the future.
We highlight key insights from each speaker in this article.
Dr. Jodie Burchell, Data Science Developer Advocate at JetBrains
“At this point, LLMs do not produce reliable code. Generating any part of a system, compiling it, and automatically deploying it can potentially lead to dangerous side effects. You are responsible for the code you put into production and for double-checking that everything that has been created is something you're happy to take ownership of.
The additional problem is a new type of security threat called prompt injection, where people can hijack LLMs to make them do things you might not want them to do. So, suppose you're giving LLMs access to databases or information your system might need access to run automatically. In that case, you risk getting hijacked, and you might dump all your customer data into the hands of someone who may be a malicious player.
Anyway, we don't use any of the data we collect for training. We don't track or store any of the code, and we won't work with any third-party providers that do so. We do have security and anti-fraud checks built into our AI service.
We've deliberately called JetBrains AI Assistant because it's designed to be a companion to you - help you be more productive, but definitely not to replace developer functionality. AI tools take boilerplate tasks that can be boring or slow down development and help speed them up by giving you a template to work with.
It collects information like the current file you're working on, the programming language, environment information, such as the dependencies you have installed, and the structure of the project file. You can also opt to have it collect recent behavior. And then, under the hood, we're building prompts based on this information and a couple of simpler ML models embedded within the IDE to predict what's most relevant for that particular context to go into the prompt. So, the result is customized for the specific problem you're working on.
You should keep in mind that AI agents' knowledge base is locked when they are trained. So, if you want to work with a problem in a very recent framework, tools like Stack Overflow or going straight to documentation might be more appropriate.
Something I say again and again is that if you think your job as a developer is to write code, you haven't understood what your job is. Many aspects of the software development job go beyond code creation, like architecture or soft skills and human understanding required to solve business problems.
So, yes, the IT jobs will change because juniors can get on board more quickly. But isn't that just an extension of what productivity tools have always been doing – shortening the learning curve and getting juniors faster to the more senior level that requires much more nuance and focus on the business context and communication?”
Andy Huang, Partner Solution Architect at Microsoft
“I like to think of LLM as a tool to accelerate developer velocity. Another reason why you might want to leverage these AI tools is to stay in the flow. I find that context switching is very expensive. Going from the IDE to a browser to another tool can be taxing. Meanwhile, staying within the IDE, thanks to AI being built into the IDE, allows you to stay focused.
AI Assistants can help developers in many ways. A junior developer might consider an approach they have not thought about before. At the same time, a senior developer might leverage AI to fill in boilerplate code to reduce repeatable tasks. On top of that, these tools can help operations teams, too. They can even help with scripting languages like Powershell and even XML or infrastructure as code such as Bicep.
Interestingly, AI Assistant can suggest codes of the same or better quality than the average developers. Now, that doesn't mean we can ignore security or DevSecOps practices. We should still absolutely include code scanning tools, dependency checks, and secret scanning. We don't want to take it as is.
We want the users to understand that these tools have limitations. The best way is to get your hands dirty and try them out a little. You are in the driver's seat and should provide context and directions. It’s not like a magic wand that will handle everything for you. You, as a developer, are still the pilot. You are the one that must review what's going on.”
Dmitry Baykov, Technical Director AI/ML at DataArt
“We will get immense value as soon as we automate the bigger chunks of work, not only in one file generation but also in one service generation or product generation, like AI generating a website or a landing page. I think that's what we will see soon – AI building a project or even a product.
The other interesting part is what we can do with AI except coding. When it comes to user stories generation, we had a project where we used AI technology to generate the acceptance criteria for building the new system from the old 30-year-old SQL code! Then, we could also generate the human-readable SQL description for developers and even migrate it to a modern programming language automatically.
It is not covered yet by any tool because it's very customized. It depends on your legacy technology, what you want to do, how fast you want to migrate, and to which quality you can automate. That's another big point where we see the applicability of AI technologies, even though they’re still in development. This project gave a 40 % productivity boost, which we measured by hours.
Another idea I want to share is LLMs assessing another LLM. There are open-source projects where people put a model in different roles and places. Let’s say I want to create a new product. I ask it to give me the idea, and then it goes through product design, UI, UX, and explaining different stuff. Then we can go with: “Treat me as a user of this product, which we're just thinking about creating, and interview me as a user.” So, we can put different masks within the same interface. This is very important because, in the future, we might be able to generate the code, evaluate it with a secure fine-tuned model, and then execute it with another piece of software, so we are sure that the code is doing what it needs to do. But it’s just a concept now.
The feature I am waiting for is the no-code level, where we don't care if it's Python or Java, where we can generate a landing page or an e-commerce website and update the website without dealing with the code, just by text.
Despite these developments, I think basic programming skills will remain important. The foundational skills for writing code, knowledge of how the Internet works, and what is HTTPS. A good thing is that these same tools can help with learning and education. You can boost productivity in education in the same way. And you can be much more confident in how you write your code and make it optimal. I think the overall learning level will increase and that the future for developers' skills is a combination of learning productivity and developer productivity.”
Conclusion
We hope these insights help you gain a better understanding of AI tools and their capabilities. Utilize them as intended to unlock their maximum potential. We believe things will only improve from here but always be sure to double-check everything. Stay tuned for updates!
