DomainShuttle

Freeform Open Domain Subject-driven Text-to-video Generation

Part 1: Cross-Domain Video Personalization
Part 1 presents additional examples of cross-domain video personalization. DomainShuttle successfully enables the mapping of real-world subjects to fantasy domains, fantasy subjects to real-world domains, and interactions between fantasy and real-world subjects.
Loading...
A man and a woman, depicted in a children's book illustration style, walk together through a sunlit meadow with tall, fluffy flowers and a distant rainbow. Smooth, gentle animation with a warm, storybook texture. Playful, colorful, whimsical hand-drawn style with soft outlines.
Loading...
A beautiful woman stands in a classroom, holding a smartphone and carefully adjusting its angle to take a photo of a sketch on the blackboard. The sketch depicts a character with a red hat and a red shirt. Sunlight streams through a nearby window, casting soft shadows on the woman and the chalkboard.
Loading...
A woman with long dark hair, wearing a white yukata with a pattern of blue and pink starfish and seaweed, a green obi, and blue geta sandals, gently licks a red lollipop while walking slowly along a traditional Japanese festival street lined with paper lanterns, holding a small woven bamboo basket in her free hand.
Loading...
A classic anime-style man with a full beard is showing a yellow hair dryer, while a classic anime-style woman holds a cloth doll with a warm smile, set in a cozy Ghibli-style room with soft sunlight filtering through paper windows and potted plants. Smooth animation, warm color palette, and detailed textures. Soft, warm lighting, hand-painted textures, detailed watercolor backgrounds.
Loading...
A man with a beard and glasses stands in front of a wall, gazing intently at a 2D anime-style graffiti of a girl. The background features a cozy, sunlit alleyway with soft shadows and warm tones. The video has a smooth texture with gentle color grading, capturing the man's quiet admiration as he slightly tilts his head while observing the artwork.
Loading...
A woman joyfully carrying a tote bag printed with the gray fantasy character in a sunlit park with blooming cherry blossoms.
Loading...
A 3D anime-style man and 3D anime-style woman, walking side by side through a colorful, whimsical park with fluffy cloud-shaped bushes and rainbow pathways, chatting happily. Video with smooth, playful animation and vibrant, candy-colored textures. Characters with big eyes and cute facial expressions.
Loading...
In a modern photography studio with soft lighting, a man stands next to a life-sized holographic figure with long blue hair, blue horns, and a blue mark on the forehead. Both are looking at a glowing roadmap floating between them; the man occasionally points at different locations on the map while the holographic figure slightly tilts its head, appearing to discuss the route details.
Loading...
A woman gently holds up a small cloth doll with a red and gold vest and black pants with flame patterns. She sits on a sunlit windowsill, smiling softly, as the warm, natural light of the real world illuminates both her and the vibrantly colored doll, creating a tender contrast between the realistic setting and the enchanted character she holds. This is a real-life scene with lifelike, highly detailed, and photorealistic textures and lighting.
Loading...
Two Line style individuals: one female with hair in a bun, one male with styled hair and facial hair. They walk side by side through a simple line-drawn urban street with basic geometric buildings and street lamps. Smooth, continuous line animation with consistent line weight throughout. Clean, minimal black line art with white negative space.
Loading...
A man gazes intently at a photographic work depicting a woman surrounded by luminous light strips. He stands still in a dimly lit, modern art gallery with sleek white walls and spotlights highlighting the artwork, cinematic lighting, and smooth video texture.
Loading...
A man with gray hair and a beard wears the fantasy character pin, happily waving his hand. Vibrant colors, smooth animation, cheerful atmosphere.
Part 2: In-Domain Video Personalization
Part 2 presents additional examples of in-domain video personalization. DomainShuttle performs well across various in-domain scenarios, including human-object interaction, multi-object generation, and multi-person generation.
Loading...
A man is facing the camera and introducing a yellow hair dryer. He holds the product with a gentle smile, presenting it to the viewer. The background features a bathroom with a wooden vanity, concrete sink and hanging plants, natural and rustic.
Loading...
In a cozy, minimalist living room dominated by white, a lively dog rests comfortably on a crisp white sofa topped with a red cushion. A pile of magazines or books is neatly stacked to the left of the sofa, creating a relaxing and organized atmosphere. The Pomeranian appears cheerful and content, occasionally stirring but mostly maintaining a stable and happy posture. The bright and tidy environment highlights the dog's lively personality and creates a peaceful and warm atmosphere.
Loading...
Two individuals standing in a field of tall grass. The setting is a rural area with a clear sky and a few scattered trees in the background. The person on the left, wearing a white shirt, is holding a smartphone and appears to be taking a selfie. The person on the right, dressed in a sleeveless top, is leaning against the other person, suggesting a close relationship. The lighting indicates it is either early morning or late afternoon, creating a warm and calm atmosphere. The two individuals continue to pose for the selfie, maintaining their positions and expressions. The tall grass sways gently in the breeze, adding to the peaceful ambiance. The background remains consistent, with the trees and clear sky providing a picturesque backdrop. The overall mood of the video is one of calmness and connection, as the two individuals enjoy their time together in the beautiful outdoor setting.
Loading...
A woman is facing the camera and introducing a product of decorative doll figurine. She smiles warmly, holding the product gently as she presents it. The background features a living room with floor lamps, potted ferns, creating a warm tranquil atmosphere.
Loading...
A darling white bunny, cozy on a blanket adorned with autumn leaves, nibbles on a bright yellow leaf, showcasing a playful curiosity in the crisp fall air. Surrounding the bunny is a picturesque scene featuring a vibrant yellow chair and a delicate bouquet of pink flowers, basking in the glow of the tranquil waters nearby. The background reveals a colorful tapestry of trees transitioning to rich autumn hues, truly capturing the essence of the season. Scattered fruits lie beside the bunny, enhancing the idyllic, serene ambiance of this enchanting scene and highlighting the beauty of nature's bounty
Loading...
The video depicts an elderly couple sitting on a light gray sofa in a well-lit living room. The man, dressed in a light blue shirt and brown pants, is holding a laptop on his lap, while the woman, wearing a checkered blouse and beige shorts, leans in closely, resting her arm on his shoulder. Both individuals appear engaged with the laptop screen, occasionally gesturing towards it with their hands. As the video progresses, the couple's expressions change from focused to surprised and then to joyful. The man raises his hand in a gesture of excitement, while the woman laughs heartily, her head tilted back slightly. Their body language suggests a shared moment of amusement or discovery. The background reveals a modern living room with a bookshelf filled with books and decorative items, a small table with a lamp, and a window letting in natural light. The overall atmosphere is cozy and domestic, emphasizing a relaxed and intimate setting. There is no noticeable camera movement; the shot remains static throughout the sequence, capturing the couple's interaction with the laptop and their reactions.
Loading...
A man is facing the camera and introducing a athletic shoe. He holds the product in his hand, looking directly at the camera. The background features a slim bookshelf, woven basket and potted fern, creating a clean and tranquil atmosphere.
Loading...
In this vibrant image, several flamingos, recognizable by their striking pink feathers, stand on the surface of shallow water, feeding. The flamingos dip their heads into colorful food bowls, particularly the red and purple ones, filled with food. They are surrounded by numerous black and gray crows, some perched on the bowls next to the flamingos, others pecking at the food themselves. The crows are very active, flapping their wings and hopping across the water, which is shown trapped by a wire fence in the background. The reflections of the flamingos and crows on the water's surface add to the lively atmosphere created by the light and shadows on the water.
Loading...
The video depicts a scene set outdoors on a sunny day, likely during breakfast or brunch. A couple is seated at a table covered with a patterned tablecloth, enjoying a casual moment together. The woman, dressed in a light gray tank top, is pouring coffee from a French press into two white cups placed on saucers. Her hair is long and dark, and she has red nail polish. The man, wearing a green t-shirt, is smiling and appears engaged in conversation with her. He gestures with his hands while speaking, and at one point, he reaches across the table to take a small piece of bread from a basket. The table also holds a small pitcher of milk and a sugar bowl, suggesting they are preparing to add cream and sugar to their coffee. The background features lush greenery and blooming pink flowers, indicating a tropical or subtropical setting. The architecture includes white columns and arches, adding to the serene ambiance. Throughout the video, the camera remains static, capturing the couple's interaction and the tranquil outdoor environment. The focus stays on the couple and their actions, with no significant camera movements or changes in perspective. The overall mood is relaxed and intimate, highlighting the simple pleasure of sharing a meal in a beautiful setting.
PART 3: Qualitative Comparison
Part 3 mainly presents qualitative comparisons between DomainShuttle and existing methods. DomainShuttle outperforms existing methods in open-domain scenarios, achieving flexible text controllability and subject consistency.
Loading...
A 3D-stylized man and a 3D-stylized woman walk side by side through a sunlit park with 3D stylized trees and clouds. Vibrant colors and 3D polished animated movie rendering.
Loading...
Two watercolor-painted people in a watercolor-painted garden engage in a gentle conversation. Soft, dreamy watercolor aesthetic with blended colors.
Loading...
Two papercut-style people standing side by side in a conversation with head turns and gestures in a minimalist papercut background of stylized trees and clouds.
Loading...
Two charcoal-sketch individuals are standing in a minimalist charcoal-drawn interior with soft light in a quiet conversation. Charcoal sketch with bold strokes and high contrast.
Loading...
Two low-poly 3D men standing in a low-poly outdoor environment with angular trees and simplified landscape, engaged in a conversation.
Loading...
A man sits on a couch in a living room, eyes fixed on the TV. On the TV, a blue robotic character is interacting with a character who has long blue hair.
Loading...
A woman shows a hot-drink paper cup printed with the endearing character gently in her hands. A real-life scene, highly detailed, and photorealistic textures.
Loading...
A man pauses on the street, turning his head to look to his right as a real-world yellow bus painted with the yellow animated character drives from the right side towards the left.
Loading...
A woman in a white gallery, holding a guide device to her ear and listening, stands beside a watercolor-style painting of the fantasy character.
Loading...
A man holds a small, cute figurine featuring white fluffy hair and black cat ears. He rotates the figurine in his hands and shows it in a clean white background.