Tencent opened source code of HunyuanPortrait for photo animation
Tencent company published source code and weight coefficients of its HunyuanPortrait project – a system for creating realistic animated portraits. This solution, based on diffusion models, allows transferring movements from source video to static image, essentially “bringing to life” photographs with impressive degree of realism.
The technical architecture of HunyuanPortrait represents a comprehensive ensemble of specialized models. SVD for generating video sequences. DiNOv2 for extracting visual features. Arc2Face for working with facial expressions. And YoloFace for reliable face detection. Such multi-component structure provides more precise control over animation and smoothness of transitions between frames compared to existing analogues.
Current implementation requires 24 gigabytes of video memory to run the inference process, which makes the technology accessible to a relatively wide circle of enthusiasts and professionals having modern graphics accelerators at their disposal. It’s important to note that the system does not yet support “text-to-motion” mode, limiting itself to transferring movements from reference video.
Open access to code and model weights opens a new chapter in the development of digital animation technologies, potentially democratizing tools previously available only to large studios and technology giants.
Autor: AIvengo
For 5 years I have been working with machine learning and artificial intelligence. And this field never ceases to amaze, inspire and interest me.
Latest News
UBTech will send Walker S2 robots to serve on China's border for $37 millionChinese company UBTech won a contract for $37 million. And will send humanoid robots Walker S2 to serve on China's border with Vietnam. South China Morning Post reports that the robots will interact with tourists and staff, perform logistics operations, inspect cargo and patrol the area. And characteristically — they can independently change their battery.
AI chatbots generate content that exacerbates eating disordersA joint study by Stanford University and the Center for Democracy and Technology showed a disturbing picture. Chatbots with artificial intelligence pose a serious risk to people with eating disorders. Scientists warn that neural networks hand out harmful advice about diets. They suggest ways to hide the disorder and generate "inspiring weight loss content" that worsens the problem.
OpenAGI released the Lux model that overtakes Google and OpenAIStartup OpenAGI released the Lux model for computer control and claims this is a breakthrough. According to benchmarks, the model overtakes analogues from Google, OpenAI and Anthropic by a whole generation. Moreover, it works faster. About 1 second per step instead of 3 seconds for competitors. And 10 times cheaper in cost per processing 1 token.
