Skip to main content

Interface

The Metaverse UI is designed for an intuitive experience across desktop, mobile, and VR.
Whether you're navigating a Verse, engaging in conversations, or interacting with objects, the UI elements help you fully immerse yourself in the digital world.

Main UI Toolbar

The main toolbar provides quick access to essential interactions within a Verse.

MUD User Interface

UI ElementFunction
InfoOpens a dialog with details about the Verse and sharing options.
PortalsDisplays a 2D sidebar with available portals in the Verse.
MuteToggles your microphone on/off.
CameraEnables/disables the camera (appears as a video in the room).
ShareShares your desktop screen as a video within the room.
EmotesOpens a menu to spawn emoji reactions in the Verse.
Raise HandDisplays a hand icon above your avatar, notifying moderators.
ParticipantsShows who's in the Verse, their device type, and moderation options.
ChatEnables text communication, object creation, and commands.
MoreExpands the toolbar with additional interaction tools (see below).
LeaveExits the current Verse and returns you to the lobby.
VR ButtonOpens the VR code to enter virtual reality, or directly transition into immersive mode if you're using a VR headset.

More Menu Options

The More menu contains additional tools for customizing your experience.

MUD User Interface

FunctionDescription
PenDraw in 3D space, adjust pen size and color, undo strokes, and generate 3D models from drawings.
Selfie CameraCapture photos or videos within the Verse. Captured content appears in the chat with a shareable link.
EmojisExpress yourself using emoji reactions within the Verse.
Share ScreenShare your device's screen with other participants in the Verse.
Raise HandIndicate that you would like to speak by using the Raise Hand icon.
Lobby CastBroadcast your avatar's point of view directly to the lobby experience.
ChatOpen the chat panel to send and receive text messages.
ParticipantsDisplay the list of active users currently in the Verse.
Generate SummaryCreate AI-generated summaries of activity within a Metaverse room.
Show 2D LayoutDisplay the Verse's 2D floor plan to assist with navigation and spatial orientation.
Manage 2D LayoutControl how the 2D experience is available to Verse users. Available options include:
- Enable 2D Layout: Enable or disable the 2D layout system for the Verse.
- Let Users Choose: Allow visitors to freely switch between 2D and 3D layouts.
- Force 2D Layout: Require all users to experience the Verse in 2D mode only.
- Force 3D Layout: Require all users to experience the Verse in 3D mode only.
AvatarSelect and place an avatar in the Verse for others to use.
UploadAdd new files or media to the Verse, including Files, Digital Art, and Digital Twin Art.
AssetsAccess uploaded and system assets for quick reuse within the Verse.
SettingsAccess Verse or user settings, depending on your permissions.
HelpAccess support resources, including Documentation, the Guided Tour, and the Report a Bug option.

Generate Summary

The Generate Summary feature allows participants to create AI-generated summaries of activity within a Metaverse room. Summaries can be generated from chat messages, voice transcriptions, private conversations, and agent interactions, making it easy to review discussions, decisions, and key topics without reading through the entire session.

MUD User Interface

Accessing Generate Summary

  1. Join a Metaverse room.
  2. Open the More Options menu () from the bottom toolbar.
  3. Under Collaboration, select Generate Summary.
  4. Select your desired Time Range.
  5. Choose the File Format.
  6. Select one or more Data Sources.
  7. Click Generate.
  8. When processing is complete, a notification will appear indicating that the summary is ready.
  9. Click Download from the notification.
  10. Save the generated file to your device.

The downloaded file will contain the AI-generated summary in the selected format.

Configuring a Summary

Before generating a summary, you can customize several options.

MUD User Interface

  • Time Range

Choose the period of activity you want to summarize.

Available options include:

OptionDescription
Last 15 minSummarizes activity from the previous 15 minutes.
Last 30 minSummarizes activity from the previous 30 minutes.
Last 1 hourSummarizes activity from the previous hour.
Last 3 hoursSummarizes activity from the previous 3 hours.
Last 24 hoursSummarizes activity from the previous 24 hours.
CustomSelect a custom date and time range.

🔹 Note: Longer time ranges may take slightly longer to process depending on the amount of data.

  • File Format

Select the format for the generated summary.

FormatDescription
PDFGenerates a downloadable PDF document suitable for sharing, printing, or archiving.
MarkdownCreates a Markdown file that can be edited or used in documentation systems.
TextGenerates a plain text file for simple viewing or import into other tools.
  • Data Sources

Choose which room data should be analyzed when generating the summary.

SourceDescription
ChatPublic chat messages exchanged in the room.
Private ChatDirect messages exchanged between participants.
Agent ChatConversations involving AI Agents in the room.
TranscriptionSpeech-to-text transcripts generated from voice conversations.

You can select one or multiple data sources depending on the information you want included in the summary.

Examples:

  • Selecting Chat and Transcription summarizes both written messages and spoken conversations.
  • Selecting Agent Chat focuses on interactions with AI agents.
  • Selecting all sources creates a comprehensive room summary.

Chat Features & Commands

Verses support public & private messaging and commands for extra functionality. In certain Verses equipped with AI Agents, you can also use the chat to interact with them, engaging in voice or text-based conversations.

Metaverse - Opened Chat Menu

Chat Commands:

CommandEffect
/leaveDisconnects from the room.
/growIncreases your avatar size.
/shrinkDecreases your avatar size.
/duckSpawns a duck object.
/flyToggles fly mode.
/scene <url>Changes the scene (Moderators only).
/rename <new name>Renames the room (Moderators only).
/audiomodeToggles spatial audio effects (Experimental).

🔹 Pro Tip: Use /fly for better mobility when navigating large Verses.

Markdown Support

The Metaverse Chat allows users to communicate effectively using Markdown formatting, enhancing readability and expressiveness within conversations.

Metaverse - Opened Chat Menu

You can style their messages dynamically using:

FeatureSyntaxExample
Bold**text** or __text__**Bold text**
Italic*text* or _text__Italic text_
Strikethrough~~text~~~~Strikethrough~~
Bold and italic***text******Bold and Italic***
Headings# Heading 1 ## Heading 2 ### Heading 3## Section Title
Lists- Item (unordered) 1. Item (ordered)- First item 1. First item
Links[Link Text](URL)[Visit Site](https://example.com)
Code Blocks`inline code` ```code block````command` ```print("Hello")```
Line BreaksText with two spaces at end Text\Line one Line two\
Task Lists- [ ] Task - [x] Completed- [ ] Buy groceries - [x] Finish project
Emoji Shortcodes:smile::smile:

AI Agents in the Metaverse

In the Metaverse, you'll find Verses with AI Agents trained on specific topics. You can interact with an Agent by:

  • Getting close to it in the Verse.
  • Starting a chat through the Participants Sidebar.

This chat allows you to engage with the AI via voice or text, creating dynamic and interactive experiences.

Chat Translation

Some chat experiences support built-in translations.

You can enable translation to receive live translations of new messages.
Translation will only apply to messages sent after the feature is activated—previous messages will not be translated. You can also disable translation at any time.

If needed, you can translate individual messages without enabling translation for the entire chat.

You can also implement chat translations in your own Metaverse experiences using AI Agents. To do this, you only need an OpenAI API Key.

Chat History

The Verse creator can download complete records of room activity for review, compliance, reporting, or archival purposes.

🔹 Note: Only the Verse Creator and hosts can access and download chat and transcription history.

Full Chat History

The Full Chat History option downloads a complete record of all public chat messages exchanged within the room.

The exported file contains:

  • Message content
  • Sender information
  • Message timestamps
  • Metadata
  • Agent chat events (if applicable)

This is useful for:

  • Meeting records
  • Auditing conversations
  • Compliance requirements
  • Post-event reviews
  • Documentation and reporting

For detailed instructions on managing chat history, refer to the dedicated section.

Objects, avatars, and media feature contextual menus for advanced controls. To access these menus, simply long-press by clicking or hovering your cursor over the object. This functionality is available across desktop, mobile, and VR devices.

MUD - Object Menu

Object Menu

OptionFunction
PinKeeps the object in the Verse when you leave.
TargetOpens a focused view of the object (for media).
ResizeAdjusts the size of the object.
Open LinkOpens the object's URL in a browser tab.
TrashRemoves the object from the scene.
GravityMakes the object fall to the floor (for 3D objects).
CloneDuplicates the object.
RotateRotates the object.
MagnifyDisplays a close-up of the object (for media).
Convert to DrawingConverts the object back to a drawing (if it originated as one).

Avatar Menu

MUD - Avatar Menu

OptionFunction
VolumeAdjusts the volume of the user's audio.
HideHides the user’s avatar and audio from you (only for your session).
MuteMutes the user’s microphone (Moderators only).
KickTemporarily removes a user from the room (Moderators only).

Camera Menu

mud - Camera Menus

OptionFunction
PhotoTakes a still image and adds it to the Verse.
VideoRecords a video and adds it to the Verse. (Temporary browser storage).

Camera Options When Object UI is Open

mud - Camera Menus

FeatureDescription
Object FocusReorients the camera to face the object or user.
Object TrackMakes the camera rotate to follow the object or user.

🔹 Pro Tip: For long recordings, use external screen recording tools like OBS, as browser storage is limited.

Drawing Menu

MUD - Drawing Menu

OptionFunction
CubeConverts the drawing into a 3D object.
UndoRemoves the last stroke.
TrashDeletes the drawing from the scene.

Info Modal & Video Controls

Info Menu

The Info button opens a dialog with Verse details and sharing options.

MUD - Invite Menu

OptionFunction
QR CodeDownload or share a QR code for mobile access.
Verse LinkCopy and share the URL for others to join.
Embed CodeGet an iframe embed code to place the Verse on a webpage.

Video Controls

When hovering over a video, audios and PDFs, media controls appear.

MUD - Video Media Controls

OptionFunction
Full-screenExpands the video to full-screen mode
VolumeAdjusts your audio playback (does not affect others).
Play/PauseStarts or pauses the video.
Time ControlsSkip forward/backward in the video.

Emotes & Raising Hand

Emoji Spawners

  • Click the Emote option in the toolbar to spawn emoji reactions.
  • These emojis are grabbable objects that emit particles when shaken.
  • They disappear automatically after a few seconds.

MUD - Emoji Spawners Menu

🔹 Pro Tip: Use emoji spawners for expressive non-verbal communication.

Raise Hand Feature

  • Click the Raise Hand button to notify moderators.
  • A hand icon appears above your avatar, signaling your request to speak.

MUD - Emoji Spawners Menu

🔹 Pro Tip: This feature is great for meetings, Q&As, and events.