Terbaru
light_mode
Beranda » LEGISLATIF » The Future of Mixed Reality: Blending the Virtual and the Real

The Future of Mixed Reality: Blending the Virtual and the Real

  • account_circle Lili Cheng
  • calendar_month Selasa, 28 Jan 2025
  • visibility 1.045
  • print Cetak

At Microsoft Ignite 2023, we are announcing Copilot in Microsoft Dynamics 365 Guides, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work.

Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex equipment and processes. New technicians need to ramp up quickly while learning how to operate and service that equipment. When equipment stops functioning, workers must act quickly to diagnose the problem, implement a fix, and then document their work. Instead of workers needing to search through volumes of digital documents or paper manuals, Copilot enables workers to ask for relevant information using natural language and human gestures, such as looking and pointing. Copilot uses generative AI to search for information from technical documentation, service records, training content, and any other data sources that customers curate. Copilot then summarizes the information to provide interactive guidance through content and holograms overlaid on the equipment in operation or maintenance.

Mixed reality together with AI presents a human-first interface that promises to transform real-world operations. Now, Copilot can assist industrial workers in real-time with speech and holograms.

Copilot in Dynamics 365 Guides capabilities

Here are the capabilities we plan to unlock with Copilot in Dynamics 365 Guides:

Point and Ask Guidance

Humans have always learned from and interacted with their environment in a hands-on manner, asking questions of others as they work. Copilot in Dynamics 365 Guides builds on that natural way of interacting to help workers better understand the world around them. Workers can point to a component on an asset and ask Copilot questions, such as “What is the torque limit for these bolts?” New workers can ask general questions, such as “What is the function of this component?” without needing to interrupt a more experienced coworker. Copilot recognizes what the user is pointing at and provides answers. 3D models and spatial maps provide the foundation for the technology to identify what the worker is looking at and then project a hologram to show instructions. Workers can ask more complex questions, such as “Which direction does this part fit?” or “Show me where the sensor module is on this machine,” and Copilot will display holograms to show where the part belongs.

Spatial Content Generation

Copilot in Dynamics 365 Guides accelerates the out-of-the-box value of mixed reality by significantly reducing the upfront investment needed to create spatial content. Copilot simplifies the creation, management, and delivery of mixed reality content using customer-defined data sources, enabling companies to adopt mixed reality much faster.

Step-by-Step Assistance

Powered by Microsoft Azure OpenAI Service, large language models allow Copilot in Dynamics 365 Guides to do far more than answer one-off questions. Workers can have progressive conversations, such as “Walk me through the steps to disassemble this filtration unit,” or “I disconnected the motor, what’s next?” Copilot follows along with the process and conversation using customer’s curated knowledge base to articulate answers with speech, text, or 3D holograms, eliminating ambiguity and reducing the need for rework.

Baca Juga

  • Wabup Kampar Dorong Paskibraka Jadi Generasi Unggul Lewat Educational Tour

    Wabup Kampar Dorong Paskibraka Jadi Generasi Unggul Lewat Educational Tour

    • calendar_month Jumat, 21 Agt 2026
    • account_circle redaksi
    • visibility 78
    • 0Komentar

    BEKASI . Lintas  Faktual.com.– Sebanyak 30 anggota Pasukan Pengibar Bendera Pusaka (Paskibraka) Kabupaten Kampar mendapat pengalaman edukatif usai menunaikan tugas pada rangkaian peringatan HUT ke-81 Kemerdekaan Republik Indonesia. Mereka mengikuti educational tour ke Politeknik Transportasi Darat Indonesia–Sekolah Tinggi Transportasi Darat (PTDI-STTD) di Bekasi, Jawa Barat, Jumat (21/8/2026). Kunjungan tersebut dipimpin langsung Wakil Bupati Kampar Dr. […]

  • Perkuat Kompetensi Guru, Universitas Pahlawan dan MGMP Bahasa Inggris Kampar Jalin Kerja Sama

    Perkuat Kompetensi Guru, Universitas Pahlawan dan MGMP Bahasa Inggris Kampar Jalin Kerja Sama

    • calendar_month Selasa, 29 Sep 2026
    • account_circle redaksi
    • visibility 65
    • 0Komentar

    KAMPAR ,Lintas Faktual,com,-  Universitas Pahlawan Tuanku Tambusai (UP) memperkuat sinerginya dengan dunia pendidikan menengah melalui kerja sama bersama Musyawarah Guru Mata Pelajaran (MGMP) Bahasa Inggris SMA Kabupaten Kampar. Kerja sama tersebut resmi ditandai dengan penandatanganan Nota Kesepahaman (MoU) antara Rektor Universitas Pahlawan Tuanku Tambusai, Prof. Dr. Amir Luthfi, dan Ketua MGMP Bahasa Inggris SMA Kabupaten […]

  • Komisi I DPRD Riau Bedah KUA-PPAS 2027 Transformasi Digital Tetap Sejalan dengan Kemampuan APBD

    Komisi I DPRD Riau Bedah KUA-PPAS 2027 Transformasi Digital Tetap Sejalan dengan Kemampuan APBD

    • calendar_month Senin, 31 Agt 2026
    • account_circle redaksi
    • visibility 258
    • 0Komentar

    KontakPekanbaru .Lintas Faktual .com,- Komisi I DPRD Provinsi Riau menggelar rapat kerja bersama Dinas Komunikasi, Informatika, dan Statistik (Diskominfotik) Provinsi Riau untuk membahas Kebijakan Umum Anggaran dan Prioritas Plafon Anggaran Sementara (KUA-PPAS) Tahun Anggaran 2027. Rapat tersebut berlangsung di Ruang Rapat Komisi I DPRD Provinsi Riau, Kamis (27/8/2026). Rapat dipimpin Sekretaris Komisi I DPRD Provinsi […]

  • Kopu Rafting “Surga” Petualangan di Hulu Kampar yang Kian Diminati Wisatawan

    Kopu Rafting “Surga” Petualangan di Hulu Kampar yang Kian Diminati Wisatawan

    • calendar_month Kamis, 27 Agt 2026
    • account_circle redaksi
    • visibility 102
    • 0Komentar

    KAMPAR .Lintas Faktual .com,- Pesona wisata alam Kabupaten Kampar, Riau, terus menghadirkan destinasi menarik bagi wisatawan. Salah satunya Kopu Rafting, wisata petualangan alam yang memadukan keindahan sungai, panorama alam, dan sensasi arung jeram di Kecamatan Koto Kampar Hulu, Kabupaten Kampar. Kopu Rafting menjadi salah satu pilihan menarik bagi wisatawan yang ingin menikmati suasana alam sekaligus […]

  • Hunger, thirst and chaos in southern Gaza as hostilities drive humanitarian aid to the brink of collapse

    Hunger, thirst and chaos in southern Gaza as hostilities drive humanitarian aid to the brink of collapse

    • calendar_month Kamis, 8 Feb 2024
    • account_circle lintasannih
    • visibility 429
    • 0Komentar

    Twelve-year-old Do’a Atef spends her days knocking on doors begging for food, or gathering firewood from a dusty hill near a refugee camp outside Rafah, in southern Gaza, to cook the few tomatoes and peppers given to her by strangers. Do’a told NBC News that she was displaced from her home in Beit Lahia in […]

  • AWI RIAU SEGERA DIKUKUHKAN, PERSIAPAN PELANTIKAN PENGURUS MULAI DIMATANGKAN

    AWI RIAU SEGERA DIKUKUHKAN, PERSIAPAN PELANTIKAN PENGURUS MULAI DIMATANGKAN

    • calendar_month Minggu, 6 Sep 2026
    • account_circle redaksi
    • visibility 102
    • 0Komentar

    Pekan baru.Lintas Faktual.com,- Aliansi Wartawan Indonesia (AWI) Provinsi Riau dalam waktu dekat akan melaksanakan pengukuhan sekaligus pelantikan kepengurusan AWI Provinsi Riau. Saat ini berbagai persiapan untuk menyukseskan kegiatan tersebut mulai dimatangkan oleh panitia. Berdasarkan rencana, acara pelantikan dan pengukuhan pengurus AWI Provinsi Riau akan dilaksanakan pada 12 Oktober 2026 mendatang. Kegiatan tersebut diharapkan menjadi momentum […]

expand_less