Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
mastodon.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
The original server operated by the Mastodon gGmbH non-profit

Administered by:

Server stats:

368K
active users

mastodon.social: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.4.0-nightly.2025-03-14-security

Public
Frederik Brudy

Creating images of imaginative worlds using generative AI can be a challenge to control using text-to-image alone. At Hai Dang will present today, work we did while he was interning with us at Autodesk Research in Toronto (with @fraseranderson, George Fitzmaurice, and me).

A screenshot of WorldSmith depicting the high-level interface. The screenshot shows the Global Tile View, Detail View, Tree View, and Result View.
Public
Frederik Brudy

WorldSmith is a novel UI & workflow for creators to composite scenes using iterative, multi-modal prompts for . 🖼️✨ It allows creators to specify their intent through text, sketching, or region-based input. 🎨

A screenshot showing a user sketch and the resulting generated images based on the sketch.
A screenshot showing 3 user-created regions highlighted in different colors. For each region, the user has created a corresponding region description.
Frederik Brudy

Images can be blended together to form one cohesive depiction of a fictional world.

A screenshot showing four image tiles. Tiles are blended into a cohesive image.
Oct 31, 2023, 03:35 PM·Public·Elk
1boost·1favorite
Public
Frederik Brudy

The progress is tracked in an interactive graph, offering a dynamic way to explore and evolve their creations. 🔍🔄

A screenshot with enlarged elements that depict the contents of a tree view at different iteration stages.
Public
Frederik Brudy

conceptualizes two expressive prompting techniques for : hierarchical prompting (which attaches prompts to different layers of the composition) and spatial prompting (allowing users to specify spatial relations through direct input).

Hierarchical Prompting allows to attach prompts to different layers of the composition: the text/region/sketch layer, the tile layer, and the blending layer.
Spatial prompting is supported through sketching and region-based prompting as well as the movable tiles that are blended together to form one cohesive image
ExploreLive feeds
About