ChatGPT creator OpenAI has released Point-E, a new AI tool for creating 3D images in minutes. Point-E, unlike other 3D image generators, does not require a high-end computer to operate.
What is ChatGPT?
Chat Generative Pre-trained Transformer is a chatbot developed by OpenAI. ChatGPT is built on OpenAI’s GPT-3.5 of the large language model, and is good with both supervised and reinforcement learning techniques. ChatGPT and GPT 3.5 were trained on the Azure AI supercomputing infrastructure. ChatGPT can chat, answer questions, create content, write and debug code, test, manipulate data, explain and tutor, and more!
What is ChatGPT used for?
ChatGPT can provide information in clear, simple sentences rather than just a list of Internet links. It can explain concepts in a way that people can easily understand. It can even generate ideas from scratch, including business strategies, Christmas gift suggestions, blog topics and holiday plans.
ChatGPT creator OpenAI has released Point-E, a new AI tool for creating 3D images in minutes. Point-E, unlike other 3D image generators, does not require a high-end computer to operate and can generate a model in less than two minutes with a single Nvidia V100.
OpenAI, the company behind the AI-powered ChatGPT chatbot and Doll-e text-to-image generator, has released a new tool that can create 3D objects based on simple text input. Dubbed Point-E, its open source is available on Github, though it’s a bit complicated to try because users need to be well-versed with command-line tools and the system requires Python, unlike ChatGPT. , where users can sign up. Visit a website and check its capabilities.
Point-E’s developers have also published a paper that explains how the platform works and what its limitations are. They claim that Point-E, unlike other 3D image generators, does not require a high-end computer to operate and can generate a model in less than two minutes with a single Nvidia V100 GPU.
How does Point-E work?
Simply put, like OpenAI’s Dull-E, Point-E can create 3D models with simple commands in English. The paper shows some bizarre examples such as “a corgi wearing a red Santa hat”, “a multicolored rainbow pumpkin”, “a pair of 3D glasses”, and “an avocado chair, a chair that imitates an avocado.” Although the tool does not create a 3D model in the traditional sense, it creates a number of data points that represent a 3D shape. The tool processes the final output after analyzing the input based on “several million 3D models” already analyzed.
wrote in the paper titled “Point E: A System for Generating 3D Point Clouds from Complex Signals”. To create a 3D object from a text prompt, we first sample and then sample an image using a text-to-image model. A 3D object sample image is optimized. Both of these steps can be completed in seconds, and do not require expensive optimization procedures. According to the research paper, Point-E is capable of efficiently creating various and complex 3D shapes conditioned on a text prompt. Our approach can serve as a starting point for further work in text-to-3D synthesis. Interestingly, Point-E researchers used OpenAI’s ChatGPT to write the paper.
Developers claim that 3D objects generated by Point-E can greatly aid in a wide range of applications such as virtual reality, gaming and industrial design.
Limitation of point-e
Like the 2D image generator Dal-E, Point-E also fails to analyze the input and its final output is displayed at low resolution. Additionally, the final output does not capture “microscopic shape or texture”. But the Point-E technique can be improved as it analyzes more real-world images. Once the system is developed, it could effectively challenge Google’s Dream Fusion, which offers more accurate results but requires more powerful hardware.
– Animesh Sharma
,