Startup uses AI to create programs from simple screenshots
Artificial intelligence is threatening worker’s jobs in dozens of different professions, from manufacturing and legal to banking and driving, and many more. Now, it’s time to add programming to that list.
A new neural network being built by a Danish startup called UIzard Technologies IVS has created an application that can transform raw designs of graphical user interfaces into actual source code that can be used to build them.
Company founder Tony Beltramelli has just published a research paper that reveals how it has achieved that. It uses cutting-edge machine learning technologies to create a neural network that can generate code automatically when it’s fed with screenshots of a GUI.
The Pix2Code model actually outperforms many human coders because it can create code for three separate platforms, including Android, iOS and “web-based technologies,” whereas many programmers are only able to do so for one platform. Pix2Code can create GUIs from screenshots with an accuracy of 77 percent, but that will improve as the algorithm learns more, the founder said.
Beltramelli created the following video clip that shows how his AI-powered app generates code in real-time:
Beltramelli has already shared some of the details about his technology on GitHub, and plans to make the full source code for Pix2Code available later this year.
A message from John Furrier, co-founder of SiliconANGLE:
Your vote of support is important to us and it helps us keep the content FREE.
One click below supports our mission to provide free, deep, and relevant content.
Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.