Skip to content

simulation

GPUSimulation

Bases: Simulation

GPU-accelerated parallel simulation using MuJoCo-Warp.

Runs n_worlds copies of the same simulation in parallel on the GPU. State queries return Warp arrays of shape (n_worlds, ...), and control inputs accept arrays of the same batch shape.

Requires an NVIDIA GPU with the [warp] extra installed.

MuJoCo Warp's warnings for reaching the solver or line search iteration limit are disabled, as in MuJoCo Playground, because they are printed once per world per step and can flood the output. To re-enable them, set sim.mjw_model.opt.warn_overflow = mjw.OverflowType.ALL before the first step.

Parameters:

Name Type Description Default
world BaseWorld

A fully configured world with at least one fly attached.

required
n_worlds int

Number of parallel simulation instances.

required
timestep float | None

Physics timestep in seconds. If None, the model's compiled-in timestep (from mujoco_globals.yaml) is used.

None
max_constraints int

Maximum number of constraints per world.

500
max_contacts int

Maximum number of contacts per world.

500
solver_tolerance float | None

Convergence tolerance of the constraint solver (option/tolerance). The default, 1e-5, is looser than MuJoCo Warp's 1e-6 (default is 1e-8 in MuJoCo but MuJoCo Warp raises it to 1e-6 for float32 computation). With 1e-6, a small fraction of worlds can stall at float32 precision until they hit the iteration limit. Since all worlds wait for the slowest one, this can reduce throughput by ~25% with 1000 worlds, without measurably improving accuracy. If None, the tolerance from the world's MJCF model is used.

1e-05

Attributes:

Name Type Description
n_worlds

Number of parallel worlds.

mjw_model

GPU-side MuJoCo-Warp model.

mjw_data

GPU-side MuJoCo-Warp data, batched over n_worlds.

Source code in src/flygym/warp/simulation.py
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
class GPUSimulation(Simulation):
    """GPU-accelerated parallel simulation using MuJoCo-Warp.

    Runs ``n_worlds`` copies of the same simulation in parallel on the GPU.
    State queries return Warp arrays of shape ``(n_worlds, ...)``, and control
    inputs accept arrays of the same batch shape.

    Requires an NVIDIA GPU with the ``[warp]`` extra installed.

    MuJoCo Warp's warnings for reaching the solver or line search iteration limit
    are disabled, as in MuJoCo Playground, because they are printed once per world
    per step and can flood the output. To re-enable them, set
    `sim.mjw_model.opt.warn_overflow = mjw.OverflowType.ALL` before the first step.

    Args:
        world: A fully configured world with at least one fly attached.
        n_worlds: Number of parallel simulation instances.
        timestep: Physics timestep in seconds. If None, the model's compiled-in
            timestep (from ``mujoco_globals.yaml``) is used.
        max_constraints: Maximum number of constraints per world.
        max_contacts: Maximum number of contacts per world.
        solver_tolerance: Convergence tolerance of the constraint solver
            (`option/tolerance`). The default, 1e-5, is looser than MuJoCo Warp's
            1e-6 (default is 1e-8 in MuJoCo but MuJoCo Warp raises it to 1e-6
            for float32 computation). With 1e-6, a small fraction of worlds can
            stall at float32 precision until they hit the iteration limit. Since
            all worlds wait for the slowest one, this can reduce throughput by
            ~25% with 1000 worlds, without measurably improving accuracy. If None,
            the tolerance from the world's MJCF model is used.

    Attributes:
        n_worlds: Number of parallel worlds.
        mjw_model: GPU-side MuJoCo-Warp model.
        mjw_data: GPU-side MuJoCo-Warp data, batched over ``n_worlds``.
    """

    @override
    def __init__(
        self,
        world: BaseWorld,
        n_worlds: int,
        *,
        timestep: float | None = None,
        max_constraints: int = 500,
        max_contacts: int = 500,
        solver_tolerance: float | None = 1e-5,
    ) -> None:
        self._strip_unsupported_options_for_mjwarp(world)
        super().__init__(world)
        # Apply overrides to the CPU model before the GPU structs are built below, so
        # they propagate into the GPU-side model.
        self._apply_option_overrides(timestep=timestep, tolerance=solver_tolerance)
        self.n_worlds = n_worlds
        self.max_constraints = max_constraints
        self.max_contacts = max_contacts
        self.mjw_model, self.mjw_data = self._mj_structs_to_mjw_structs()

    @override
    def reset(self) -> None:
        """Reset all parallel worlds to the neutral keyframe.

        !!! warning

            `reset()` does not update derived kinematic quantities (`xpos`,
            `xquat`, `site_xpos`, ...); it only restores state fields
            (`qpos`, `qvel`, `act`, `ctrl`, `mocap`, `time`). Reading
            derived quantities right after `reset()`, before calling `forward()` or
            `step()`, returns stale values from before the reset. This is consistent
            with the behavior of MuJoCo Warp's native `reset_data()` function.
        """
        super().reset()
        mjw.reset_data_keyframe(
            self.mjw_model, self.mjw_data, self._neutral_keyframe_id
        )

    def set_state(
        self,
        qpos: Float[np.ndarray | wp.array, "n_worlds nq"] | None = None,
        qvel: Float[np.ndarray | wp.array, "n_worlds nv"] | None = None,
        worlds_mask: wp.array | np.ndarray | None = None,
    ) -> None:
        """Directly set generalized positions and/or velocities for parallel worlds.

        Unlike `reset`, which restores the single neutral keyframe to every (masked)
        world, this writes a possibly different `qpos`/`qvel` per world. It is the
        building block for reference-state initialization, where each world starts an
        episode from a different reference pose.

        Args:
            qpos: Optional generalized positions, shape ``(n_worlds, nq)``. Accepts
                numpy or Warp arrays. If None, positions are left unchanged.
            qvel: Optional generalized velocities, shape ``(n_worlds, nv)``. Accepts
                numpy or Warp arrays. If None, velocities are left unchanged.
            worlds_mask: Optional per-world boolean mask, shape ``(n_worlds,)``. Only
                masked worlds are written; the rest keep their current state. Defaults
                to all worlds.

        !!! warning

            Like `reset`, this does not update derived kinematic quantities (`xpos`,
            `xquat`, `site_xpos`, velocities, ...). Call `forward` (or `step`) before
            reading them, otherwise getters return stale pre-write values.
        """
        if qpos is None and qvel is None:
            return
        if worlds_mask is None:
            mask = wp.ones(self.n_worlds, dtype=wp.bool)
        elif isinstance(worlds_mask, wp.array):
            mask = worlds_mask
        else:
            mask = wp.array(worlds_mask, dtype=wp.bool)
        if mask.shape != (self.n_worlds,):
            raise ValueError(
                f"`worlds_mask` must have shape ({self.n_worlds},), got {mask.shape}."
            )
        for name, src, dst in (
            ("qpos", qpos, self.mjw_data.qpos),
            ("qvel", qvel, self.mjw_data.qvel),
        ):
            if src is None:
                continue
            if isinstance(src, wp.array):
                if src.dtype != wp.float32:
                    raise TypeError(
                        f"`{name}` must be a float32 Warp array, got dtype "
                        f"{wp.types.type_repr(src.dtype)}."
                    )
            else:
                src = wp.array(src, dtype=wp.float32)
            if src.shape != dst.shape:
                raise ValueError(
                    f"`{name}` must have shape {dst.shape}, got {src.shape}."
                )
            wp.launch(
                wp_masked_copy_rows_2d,
                dim=dst.shape,
                inputs=[src, dst, mask],
            )

    @override
    def get_joint_angles(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds n_jointdofs"]:
        """Get joint angles for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, n_jointdofs)`` in radians, ordered as in
            ``fly.get_jointdofs_order()``.
        """
        indices = self._wp_intern_qposadrs_by_fly[fly_name]
        if dst is None:
            dst = wp.zeros((self.n_worlds, indices.size), dtype=wp.float32)
        wp.launch(
            wp_gather_indexed_cols_2d,
            dim=(self.n_worlds, indices.size),
            inputs=[self.mjw_data.qpos, dst, indices],
        )
        return dst

    @override
    def get_joint_velocities(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds n_jointdofs"]:
        """Get joint velocities for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

        Returns:
            Warp array of shape ``(n_worlds, n_jointdofs)`` in radians per second,
            ordered as in ``fly.get_jointdofs_order()``.
        """
        indices = self._wp_intern_qveladrs_by_fly[fly_name]
        if dst is None:
            dst = wp.zeros((self.n_worlds, indices.size), dtype=wp.float32)
        wp.launch(
            wp_gather_indexed_cols_2d,
            dim=(self.n_worlds, indices.size),
            inputs=[self.mjw_data.qvel, dst, indices],
        )
        return dst

    def get_base_linear_velocity(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds 3"]:
        """Get the linear velocity of the fly's base (free joint) for all worlds.

        The base velocity is not part of ``get_joint_velocities`` (which covers only the
        fly's articulated DOFs). It is only defined for a fly attached to the world by a
        free joint (the usual walking setup); tethered flies have none.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, 3)`` in mm/s, in the **world** frame.

        Raises:
            KeyError: If the fly has no free (base) joint.
        """
        indices = self._require_base_veladrs(fly_name, self._wp_base_linveladrs_by_fly)
        if dst is None:
            dst = wp.zeros((self.n_worlds, 3), dtype=wp.float32)
        wp.launch(
            wp_gather_indexed_cols_2d,
            dim=(self.n_worlds, 3),
            inputs=[self.mjw_data.qvel, dst, indices],
        )
        return dst

    def get_base_angular_velocity(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds 3"]:
        """Get the angular velocity of the fly's base (free joint) for all worlds.

        See ``get_base_linear_velocity`` for when the base velocity is defined.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, 3)`` in rad/s, in the **root-body** frame
            (MuJoCo's native free-joint angular-velocity convention).

        Raises:
            KeyError: If the fly has no free (base) joint.
        """
        indices = self._require_base_veladrs(fly_name, self._wp_base_angveladrs_by_fly)
        if dst is None:
            dst = wp.zeros((self.n_worlds, 3), dtype=wp.float32)
        wp.launch(
            wp_gather_indexed_cols_2d,
            dim=(self.n_worlds, 3),
            inputs=[self.mjw_data.qvel, dst, indices],
        )
        return dst

    @staticmethod
    def _require_base_veladrs(fly_name: str, adrs_by_fly: dict) -> wp.array:
        if fly_name not in adrs_by_fly:
            raise KeyError(
                f"Fly '{fly_name}' has no free (base) joint, so its base velocity is "
                "undefined (is it tethered?)."
            )
        return adrs_by_fly[fly_name]

    @override
    def get_body_positions(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds n_bodies 3"]:
        """Get global body positions for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, n_bodies, 3)`` in mm, ordered as in
            ``fly.get_bodysegs_order()``.
        """
        indices = self._wp_internal_bodyids_by_fly[fly_name]
        if dst is None:
            dst = wp.zeros((self.n_worlds, indices.size, 3), dtype=wp.float32)
        wp.launch(
            wp_gather_offset_body_positions,
            dim=(self.n_worlds, indices.size),
            inputs=[
                self.mjw_data.xpos,
                self.mjw_data.xmat,
                dst,
                indices,
                self._wp_body_relpos_by_fly[fly_name],
            ],
        )
        return dst

    @override
    def get_body_rotations(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds n_bodies 4"]:
        """Get global body orientations as quaternions for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, n_bodies, 4)`` (w, x, y, z), ordered as
            in ``fly.get_bodysegs_order()``.
        """
        indices = self._wp_internal_bodyids_by_fly[fly_name]
        if dst is None:
            dst = wp.zeros((self.n_worlds, indices.size, 4), dtype=wp.float32)
        wp.launch(
            wp_gather_offset_body_rotations,
            dim=(self.n_worlds, indices.size),
            inputs=[
                self.mjw_data.xquat,
                dst,
                indices,
                self._wp_body_relquat_by_fly[fly_name],
            ],
        )
        return dst

    @override
    def get_site_positions(
        self, fly_name: str, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds n_sites 3"]:
        """Get global anatomical-joint site positions for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, n_sites, 3)`` in mm, ordered as in
            ``fly.get_sites_order()``.
        """
        indices = self._wp_internal_siteids_by_fly[fly_name]
        if dst is None:
            dst = wp.zeros((self.n_worlds, indices.size, 3), dtype=wp.float32)
        wp.launch(
            wp_gather_indexed_rows_vec3f,
            dim=(self.n_worlds, indices.size),
            inputs=[self.mjw_data.site_xpos, dst, indices],
        )
        return dst

    @property  # type: ignore[override]
    def time(self) -> float:
        """Current simulation time in seconds (from world 0)."""
        return float(self.mjw_data.time.numpy()[0])

    @override
    def get_actuator_forces(
        self, fly_name: str, actuator_type: ActuatorType, dst: wp.array | None = None
    ) -> Float[wp.array, "n_worlds n_actuators"]:
        """Get actuator forces for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            actuator_type: Type of actuator to query.
            dst: Optional warp array to store the result. If not specified, a new array
                is allocated.

        Returns:
            Warp array of shape ``(n_worlds, n_actuators)``, ordered as in
            ``fly.get_actuated_jointdofs_order(actuator_type)``.
        """
        indices = self._wp_intern_actuatorids_by_type_by_fly[actuator_type][fly_name]
        if dst is None:
            dst = wp.zeros((self.n_worlds, indices.size), dtype=wp.float32)
        wp.launch(
            wp_gather_indexed_cols_2d,
            dim=(self.n_worlds, indices.size),
            inputs=[self.mjw_data.actuator_force, dst, indices],
        )
        return dst

    @override
    def set_leg_adhesion_states(
        self,
        fly_name: str,
        leg_to_adhesion_state: Float[np.ndarray | wp.array, "n_worlds 6"],
    ) -> None:
        """Set adhesion states for each leg across all parallel worlds.

        Args:
            fly_name: Name of the fly.
            leg_to_adhesion_state: Adhesion control array, shape ``(n_worlds, 6)``,
                ordered as in ``fly.get_legs_order()``. Values should be in the range
                ``[0, 1]``. Accepts numpy or Warp arrays.
        """
        if not isinstance(leg_to_adhesion_state, wp.array):
            leg_to_adhesion_state = wp.array(leg_to_adhesion_state, dtype=wp.float32)
        indices = self._wp_intern_adhesionactuatorids_by_fly[fly_name]
        wp.launch(
            wp_scatter_indexed_cols_2d,
            dim=(self.n_worlds, indices.size),
            inputs=[leg_to_adhesion_state, self.mjw_data.ctrl, indices],
        )

    @override
    def set_actuator_inputs(
        self,
        fly_name: str,
        actuator_type: ActuatorType,
        inputs: Float[np.ndarray | wp.array, "n_worlds n_actuators"],
    ) -> None:
        """Set control inputs for all parallel worlds.

        Args:
            fly_name: Name of the fly.
            actuator_type: Type of actuator to control.
            inputs: Control inputs, shape ``(n_worlds, n_actuators)``, ordered as in
                ``fly.get_actuated_jointdofs_order(actuator_type)``. Accepts numpy or
                Warp arrays.
        """
        if not isinstance(inputs, wp.array):
            inputs = wp.array(inputs, dtype=wp.float32)
        indices = self._wp_intern_actuatorids_by_type_by_fly[actuator_type][fly_name]
        wp.launch(
            wp_scatter_indexed_cols_2d,
            dim=(self.n_worlds, indices.size),
            inputs=[inputs, self.mjw_data.ctrl, indices],
        )

    @override
    def step(self) -> None:
        """Advance all parallel worlds by one timestep on the GPU."""
        mjw.step(self.mjw_model, self.mjw_data)

    @override
    def forward(self) -> None:
        """Recompute derived quantities for all parallel worlds on the GPU, without
        integrating. Call this after writing state directly (e.g. via `set_state` or
        `reset`) so that subsequent getters return up-to-date values.
        """
        mjw.forward(self.mjw_model, self.mjw_data)

    @override
    def set_renderer(
        self,
        cameras: str | mj.MjsCamera | list[str | mj.MjsCamera],
        *,
        camera_res: tuple[int, int] = (240, 320),
        playback_speed: float = 0.2,
        output_fps: int = 25,
        buffer_frames: bool = True,
        scene_option: mj.MjvOption | None = None,
        worlds: list[int] | None = None,
        use_gpu_batch_rendering: bool = False,
        **kwargs: Any,
    ) -> WarpGPUBatchRenderer | WarpCPURenderer:
        """Attach a renderer to this GPU simulation.

        Args:
            cameras: Camera(s) to render.
            camera_res: ``(height, width)`` in pixels.
            playback_speed: Video playback speed relative to real time.
            output_fps: Output video frame rate.
            buffer_frames: If True, store rendered frames in memory.
            scene_option: MuJoCo scene options. Uses defaults if None.
            worlds: Indices of worlds to render. Defaults to all worlds.
            use_gpu_batch_rendering: If True, use `WarpGPUBatchRenderer`;
                otherwise use `WarpCPURenderer`.
            **kwargs: Passed to the renderer.

        Returns:
            The created renderer instance.
        """
        if worlds is None:
            worlds = list(range(self.n_worlds))
        self.use_gpu_batch_rendering = use_gpu_batch_rendering

        renderer_kwargs = {
            "mj_model": self.mj_model,
            "n_worlds_total": self.n_worlds,
            "cameras": cameras,
            "camera_res": camera_res,
            "playback_speed": playback_speed,
            "output_fps": output_fps,
            "buffer_frames": buffer_frames,
            "scene_option": scene_option,
            "worlds": worlds,
            **kwargs,
        }
        if use_gpu_batch_rendering:
            is_model_modified = modify_world_for_batch_rendering(self.world)
            if is_model_modified:
                warnings.warn(
                    "The world was modified to be compatible with GPU batch rendering. "
                    "Recompiling the model."
                )
                # Carry option overrides over to the recompiled model
                timestep = self.mj_model.opt.timestep
                tolerance = self.mj_model.opt.tolerance
                self.mj_model, self.mj_data = self.world.compile()
                self._apply_option_overrides(timestep=timestep, tolerance=tolerance)
                self._neutral_keyframe_id = mj.mj_name2id(
                    self.mj_model, mj.mjtObj.mjOBJ_KEY, "neutral"
                )
                mj.mj_resetDataKeyframe(
                    self.mj_model, self.mj_data, self._neutral_keyframe_id
                )
                self.mjw_model, self.mjw_data = self._mj_structs_to_mjw_structs()
                renderer_kwargs["mj_model"] = self.mj_model
            self.renderer = WarpGPUBatchRenderer(**renderer_kwargs)
        else:
            self.renderer = WarpCPURenderer(**renderer_kwargs)

        return self.renderer

    @override
    def render_as_needed(self) -> bool:
        """Render frames for all configured cameras if enough time has elapsed.

        Returns:
            True if a render occurred, False otherwise.
        """
        return self.renderer.render_as_needed(self.mjw_data)

    @override
    def set_trajectory_recorder(
        self,
        *,
        playback_speed: float = 0.2,
        output_fps: int = 25,
        worlds: list[int] | None = None,
    ) -> WarpTrajectoryRecorder:
        """Attach a recorder that stores the kinematic state at the video frame rate.

        The recorded trajectories can be rendered to video later with
        `flygym.warp.recording.render_trajectories_gpu` or
        `flygym.recording.render_trajectories`. See `flygym.recording` for details. The
        recorder is independent of the renderer: either or both can be attached.

        Args:
            playback_speed: Video playback speed relative to real time.
            output_fps: Output video frame rate.
            worlds: Indices of worlds to record. Defaults to all worlds.

        Returns:
            The created `WarpTrajectoryRecorder` instance.
        """
        self.recorder = WarpTrajectoryRecorder(
            self.mj_model,
            self.n_worlds,
            worlds=worlds,
            playback_speed=playback_speed,
            output_fps=output_fps,
        )
        return self.recorder

    @override
    def record_as_needed(self) -> bool:
        """Record the kinematic state of the selected worlds if enough simulation time
        has elapsed since the last recorded frame.

        Returns:
            True if a frame was recorded, False otherwise.
        """
        return self.recorder.record_as_needed(self.mjw_data)

    @override
    def print_performance_report(
        self, show_in_notebook: bool | Literal["auto"] = "auto"
    ) -> None:
        """Print a parallel-simulation performance report.

        Requires that `step_with_profile` and `render_as_needed_with_profile` were
        used during the simulation loop.

        Args:
            show_in_notebook: If True, render the report as an HTML table suitable for
                display in a Jupyter notebook. If "auto", will attempt to detect if
                we're in a notebook environment and choose accordingly.
        """
        print_perf_report_parallel(
            n_steps=self._curr_step,
            n_frames_rendered=self._frames_rendered,
            total_physics_time_ns=self._total_physics_time_ns,
            total_render_time_ns=self._total_render_time_ns,
            timestep=self.timestep,
            n_worlds=self.n_worlds,
            n_worlds_rendered=len(self.renderer.world_ids),
            show_in_notebook=show_in_notebook,
        )

    @override
    def _map_internal_bodyids(self) -> None:
        super()._map_internal_bodyids()
        self._wp_internal_bodyids_by_fly = {
            k: wp.array(v, dtype=wp.int32)
            for k, v in self._internal_bodyids_by_fly.items()
        }
        self._wp_body_relpos_by_fly = {
            k: wp.array(v, dtype=wp.vec3) for k, v in self._body_relpos_by_fly.items()
        }
        self._wp_body_relquat_by_fly = {
            k: wp.array(v, dtype=wp.quat) for k, v in self._body_relquat_by_fly.items()
        }

    @override
    def _map_internal_qposqveladrs(self) -> None:
        super()._map_internal_qposqveladrs()
        self._wp_intern_qposadrs_by_fly = {
            k: wp.array(v, dtype=wp.int32)
            for k, v in self._intern_qposadrs_by_fly.items()
        }
        self._wp_intern_qveladrs_by_fly = {
            k: wp.array(v, dtype=wp.int32)
            for k, v in self._intern_qveladrs_by_fly.items()
        }
        # Base ("free") joint velocity addresses, used by get_base_*_velocity. The world
        # attaches each walking fly's root body to the world with a free joint named
        # after the fly; its 6 velocity DOFs are laid out as [linear xyz, angular xyz].
        # Flies without a free joint (e.g. tethered) are simply left out of these maps.
        self._wp_base_linveladrs_by_fly = {}
        self._wp_base_angveladrs_by_fly = {}
        for fly_name in self._intern_qveladrs_by_fly:
            jid = mj.mj_name2id(self.mj_model, mj.mjtObj.mjOBJ_JOINT, fly_name)
            if jid < 0 or self.mj_model.jnt_type[jid] != mj.mjtJoint.mjJNT_FREE:
                continue
            vadr = int(self.mj_model.jnt_dofadr[jid])
            self._wp_base_linveladrs_by_fly[fly_name] = wp.array(
                [vadr, vadr + 1, vadr + 2], dtype=wp.int32
            )
            self._wp_base_angveladrs_by_fly[fly_name] = wp.array(
                [vadr + 3, vadr + 4, vadr + 5], dtype=wp.int32
            )

    @override
    def _map_internal_actuator_ids(self) -> None:
        super()._map_internal_actuator_ids()
        self._wp_intern_actuatorids_by_type_by_fly = {
            ty: {
                fly_name: wp.array(ids, dtype=wp.int32)
                for fly_name, ids in ids_by_fly.items()
            }
            for ty, ids_by_fly in self._intern_actuatorids_by_type_by_fly.items()
        }

    @override
    def _map_internal_adhesionactuator_ids(self) -> None:
        super()._map_internal_adhesionactuator_ids()
        self._wp_intern_adhesionactuatorids_by_fly = {
            k: wp.array(v, dtype=wp.int32)
            for k, v in self._intern_adhesionactuatorids_by_fly.items()
        }

    @override
    def _map_internal_site_ids(self) -> None:
        super()._map_internal_site_ids()
        self._wp_internal_siteids_by_fly = {
            k: wp.array(v, dtype=wp.int32)
            for k, v in self._internal_siteids_by_fly.items()
        }

    def _apply_option_overrides(
        self, *, timestep: float | None, tolerance: float | None
    ) -> None:
        """Override options in `mj_model.opt`. None leaves an option unchanged."""
        if timestep is not None:
            self.mj_model.opt.timestep = timestep
        if tolerance is not None:
            self.mj_model.opt.tolerance = tolerance

    def _mj_structs_to_mjw_structs(self) -> tuple[mjw.Model, mjw.Data]:
        mjw_model = mjw.put_model(self.mj_model)
        # Silence per-world solver and line search iteration limit warnings, as in
        # MuJoCo Playground (https://github.com/google-deepmind/mujoco_playground/commit/fb246cd).
        # Buffer overflow warnings (contacts, constraints) remain.
        mjw_model.opt.warn_overflow &= ~(
            mjw.OverflowType.ITERATIONS | mjw.OverflowType.LS_ITERATIONS
        )
        mjw_data = mjw.put_data(
            self.mj_model,
            self.mj_data,
            nworld=self.n_worlds,
            njmax=self.max_constraints,
            nconmax=self.max_contacts,
        )
        return mjw_model, mjw_data

    @staticmethod
    def _strip_unsupported_options_for_mjwarp(world: BaseWorld) -> bool:
        """Remove specs in world MJCF model that are unsupported in MJWarp.

        Modification happens in place. Returns True if any modifications were made,
        False otherwise.

        Note for developers: Check if anything here can be dropped upon new MJWarp
        releases.
        """
        is_modified = False

        # Noslip solver not supported
        if (noslip_iters := world.mjcf_root.option.noslip_iterations) > 0:
            warnings.warn(
                "MJWarp does not support noslip iterations. Changing "
                f"option/noslip_iterations from {noslip_iters} to 0."
            )
            world.mjcf_root.option.noslip_iterations = 0
            is_modified = True

        return is_modified

    @property
    def timestep(self) -> float:
        """Simulation timestep in seconds."""
        return self.mj_model.opt.timestep

time property

Current simulation time in seconds (from world 0).

timestep property

Simulation timestep in seconds.

forward()

Recompute derived quantities for all parallel worlds on the GPU, without integrating. Call this after writing state directly (e.g. via set_state or reset) so that subsequent getters return up-to-date values.

Source code in src/flygym/warp/simulation.py
@override
def forward(self) -> None:
    """Recompute derived quantities for all parallel worlds on the GPU, without
    integrating. Call this after writing state directly (e.g. via `set_state` or
    `reset`) so that subsequent getters return up-to-date values.
    """
    mjw.forward(self.mjw_model, self.mjw_data)

get_actuator_forces(fly_name, actuator_type, dst=None)

Get actuator forces for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
actuator_type ActuatorType

Type of actuator to query.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds n_actuators']

Warp array of shape (n_worlds, n_actuators), ordered as in

Float[array, 'n_worlds n_actuators']

fly.get_actuated_jointdofs_order(actuator_type).

Source code in src/flygym/warp/simulation.py
@override
def get_actuator_forces(
    self, fly_name: str, actuator_type: ActuatorType, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds n_actuators"]:
    """Get actuator forces for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        actuator_type: Type of actuator to query.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, n_actuators)``, ordered as in
        ``fly.get_actuated_jointdofs_order(actuator_type)``.
    """
    indices = self._wp_intern_actuatorids_by_type_by_fly[actuator_type][fly_name]
    if dst is None:
        dst = wp.zeros((self.n_worlds, indices.size), dtype=wp.float32)
    wp.launch(
        wp_gather_indexed_cols_2d,
        dim=(self.n_worlds, indices.size),
        inputs=[self.mjw_data.actuator_force, dst, indices],
    )
    return dst

get_base_angular_velocity(fly_name, dst=None)

Get the angular velocity of the fly's base (free joint) for all worlds.

See get_base_linear_velocity for when the base velocity is defined.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds 3']

Warp array of shape (n_worlds, 3) in rad/s, in the root-body frame

Float[array, 'n_worlds 3']

(MuJoCo's native free-joint angular-velocity convention).

Raises:

Type Description
KeyError

If the fly has no free (base) joint.

Source code in src/flygym/warp/simulation.py
def get_base_angular_velocity(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds 3"]:
    """Get the angular velocity of the fly's base (free joint) for all worlds.

    See ``get_base_linear_velocity`` for when the base velocity is defined.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, 3)`` in rad/s, in the **root-body** frame
        (MuJoCo's native free-joint angular-velocity convention).

    Raises:
        KeyError: If the fly has no free (base) joint.
    """
    indices = self._require_base_veladrs(fly_name, self._wp_base_angveladrs_by_fly)
    if dst is None:
        dst = wp.zeros((self.n_worlds, 3), dtype=wp.float32)
    wp.launch(
        wp_gather_indexed_cols_2d,
        dim=(self.n_worlds, 3),
        inputs=[self.mjw_data.qvel, dst, indices],
    )
    return dst

get_base_linear_velocity(fly_name, dst=None)

Get the linear velocity of the fly's base (free joint) for all worlds.

The base velocity is not part of get_joint_velocities (which covers only the fly's articulated DOFs). It is only defined for a fly attached to the world by a free joint (the usual walking setup); tethered flies have none.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds 3']

Warp array of shape (n_worlds, 3) in mm/s, in the world frame.

Raises:

Type Description
KeyError

If the fly has no free (base) joint.

Source code in src/flygym/warp/simulation.py
def get_base_linear_velocity(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds 3"]:
    """Get the linear velocity of the fly's base (free joint) for all worlds.

    The base velocity is not part of ``get_joint_velocities`` (which covers only the
    fly's articulated DOFs). It is only defined for a fly attached to the world by a
    free joint (the usual walking setup); tethered flies have none.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, 3)`` in mm/s, in the **world** frame.

    Raises:
        KeyError: If the fly has no free (base) joint.
    """
    indices = self._require_base_veladrs(fly_name, self._wp_base_linveladrs_by_fly)
    if dst is None:
        dst = wp.zeros((self.n_worlds, 3), dtype=wp.float32)
    wp.launch(
        wp_gather_indexed_cols_2d,
        dim=(self.n_worlds, 3),
        inputs=[self.mjw_data.qvel, dst, indices],
    )
    return dst

get_body_positions(fly_name, dst=None)

Get global body positions for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds n_bodies 3']

Warp array of shape (n_worlds, n_bodies, 3) in mm, ordered as in

Float[array, 'n_worlds n_bodies 3']

fly.get_bodysegs_order().

Source code in src/flygym/warp/simulation.py
@override
def get_body_positions(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds n_bodies 3"]:
    """Get global body positions for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, n_bodies, 3)`` in mm, ordered as in
        ``fly.get_bodysegs_order()``.
    """
    indices = self._wp_internal_bodyids_by_fly[fly_name]
    if dst is None:
        dst = wp.zeros((self.n_worlds, indices.size, 3), dtype=wp.float32)
    wp.launch(
        wp_gather_offset_body_positions,
        dim=(self.n_worlds, indices.size),
        inputs=[
            self.mjw_data.xpos,
            self.mjw_data.xmat,
            dst,
            indices,
            self._wp_body_relpos_by_fly[fly_name],
        ],
    )
    return dst

get_body_rotations(fly_name, dst=None)

Get global body orientations as quaternions for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds n_bodies 4']

Warp array of shape (n_worlds, n_bodies, 4) (w, x, y, z), ordered as

Float[array, 'n_worlds n_bodies 4']

in fly.get_bodysegs_order().

Source code in src/flygym/warp/simulation.py
@override
def get_body_rotations(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds n_bodies 4"]:
    """Get global body orientations as quaternions for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, n_bodies, 4)`` (w, x, y, z), ordered as
        in ``fly.get_bodysegs_order()``.
    """
    indices = self._wp_internal_bodyids_by_fly[fly_name]
    if dst is None:
        dst = wp.zeros((self.n_worlds, indices.size, 4), dtype=wp.float32)
    wp.launch(
        wp_gather_offset_body_rotations,
        dim=(self.n_worlds, indices.size),
        inputs=[
            self.mjw_data.xquat,
            dst,
            indices,
            self._wp_body_relquat_by_fly[fly_name],
        ],
    )
    return dst

get_joint_angles(fly_name, dst=None)

Get joint angles for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds n_jointdofs']

Warp array of shape (n_worlds, n_jointdofs) in radians, ordered as in

Float[array, 'n_worlds n_jointdofs']

fly.get_jointdofs_order().

Source code in src/flygym/warp/simulation.py
@override
def get_joint_angles(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds n_jointdofs"]:
    """Get joint angles for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, n_jointdofs)`` in radians, ordered as in
        ``fly.get_jointdofs_order()``.
    """
    indices = self._wp_intern_qposadrs_by_fly[fly_name]
    if dst is None:
        dst = wp.zeros((self.n_worlds, indices.size), dtype=wp.float32)
    wp.launch(
        wp_gather_indexed_cols_2d,
        dim=(self.n_worlds, indices.size),
        inputs=[self.mjw_data.qpos, dst, indices],
    )
    return dst

get_joint_velocities(fly_name, dst=None)

Get joint velocities for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array

None

Returns:

Type Description
Float[array, 'n_worlds n_jointdofs']

Warp array of shape (n_worlds, n_jointdofs) in radians per second,

Float[array, 'n_worlds n_jointdofs']

ordered as in fly.get_jointdofs_order().

Source code in src/flygym/warp/simulation.py
@override
def get_joint_velocities(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds n_jointdofs"]:
    """Get joint velocities for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
        is allocated.

    Returns:
        Warp array of shape ``(n_worlds, n_jointdofs)`` in radians per second,
        ordered as in ``fly.get_jointdofs_order()``.
    """
    indices = self._wp_intern_qveladrs_by_fly[fly_name]
    if dst is None:
        dst = wp.zeros((self.n_worlds, indices.size), dtype=wp.float32)
    wp.launch(
        wp_gather_indexed_cols_2d,
        dim=(self.n_worlds, indices.size),
        inputs=[self.mjw_data.qvel, dst, indices],
    )
    return dst

get_site_positions(fly_name, dst=None)

Get global anatomical-joint site positions for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
dst array | None

Optional warp array to store the result. If not specified, a new array is allocated.

None

Returns:

Type Description
Float[array, 'n_worlds n_sites 3']

Warp array of shape (n_worlds, n_sites, 3) in mm, ordered as in

Float[array, 'n_worlds n_sites 3']

fly.get_sites_order().

Source code in src/flygym/warp/simulation.py
@override
def get_site_positions(
    self, fly_name: str, dst: wp.array | None = None
) -> Float[wp.array, "n_worlds n_sites 3"]:
    """Get global anatomical-joint site positions for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        dst: Optional warp array to store the result. If not specified, a new array
            is allocated.

    Returns:
        Warp array of shape ``(n_worlds, n_sites, 3)`` in mm, ordered as in
        ``fly.get_sites_order()``.
    """
    indices = self._wp_internal_siteids_by_fly[fly_name]
    if dst is None:
        dst = wp.zeros((self.n_worlds, indices.size, 3), dtype=wp.float32)
    wp.launch(
        wp_gather_indexed_rows_vec3f,
        dim=(self.n_worlds, indices.size),
        inputs=[self.mjw_data.site_xpos, dst, indices],
    )
    return dst

print_performance_report(show_in_notebook='auto')

Print a parallel-simulation performance report.

Requires that step_with_profile and render_as_needed_with_profile were used during the simulation loop.

Parameters:

Name Type Description Default
show_in_notebook bool | Literal['auto']

If True, render the report as an HTML table suitable for display in a Jupyter notebook. If "auto", will attempt to detect if we're in a notebook environment and choose accordingly.

'auto'
Source code in src/flygym/warp/simulation.py
@override
def print_performance_report(
    self, show_in_notebook: bool | Literal["auto"] = "auto"
) -> None:
    """Print a parallel-simulation performance report.

    Requires that `step_with_profile` and `render_as_needed_with_profile` were
    used during the simulation loop.

    Args:
        show_in_notebook: If True, render the report as an HTML table suitable for
            display in a Jupyter notebook. If "auto", will attempt to detect if
            we're in a notebook environment and choose accordingly.
    """
    print_perf_report_parallel(
        n_steps=self._curr_step,
        n_frames_rendered=self._frames_rendered,
        total_physics_time_ns=self._total_physics_time_ns,
        total_render_time_ns=self._total_render_time_ns,
        timestep=self.timestep,
        n_worlds=self.n_worlds,
        n_worlds_rendered=len(self.renderer.world_ids),
        show_in_notebook=show_in_notebook,
    )

record_as_needed()

Record the kinematic state of the selected worlds if enough simulation time has elapsed since the last recorded frame.

Returns:

Type Description
bool

True if a frame was recorded, False otherwise.

Source code in src/flygym/warp/simulation.py
@override
def record_as_needed(self) -> bool:
    """Record the kinematic state of the selected worlds if enough simulation time
    has elapsed since the last recorded frame.

    Returns:
        True if a frame was recorded, False otherwise.
    """
    return self.recorder.record_as_needed(self.mjw_data)

render_as_needed()

Render frames for all configured cameras if enough time has elapsed.

Returns:

Type Description
bool

True if a render occurred, False otherwise.

Source code in src/flygym/warp/simulation.py
@override
def render_as_needed(self) -> bool:
    """Render frames for all configured cameras if enough time has elapsed.

    Returns:
        True if a render occurred, False otherwise.
    """
    return self.renderer.render_as_needed(self.mjw_data)

reset()

Reset all parallel worlds to the neutral keyframe.

Warning

reset() does not update derived kinematic quantities (xpos, xquat, site_xpos, ...); it only restores state fields (qpos, qvel, act, ctrl, mocap, time). Reading derived quantities right after reset(), before calling forward() or step(), returns stale values from before the reset. This is consistent with the behavior of MuJoCo Warp's native reset_data() function.

Source code in src/flygym/warp/simulation.py
@override
def reset(self) -> None:
    """Reset all parallel worlds to the neutral keyframe.

    !!! warning

        `reset()` does not update derived kinematic quantities (`xpos`,
        `xquat`, `site_xpos`, ...); it only restores state fields
        (`qpos`, `qvel`, `act`, `ctrl`, `mocap`, `time`). Reading
        derived quantities right after `reset()`, before calling `forward()` or
        `step()`, returns stale values from before the reset. This is consistent
        with the behavior of MuJoCo Warp's native `reset_data()` function.
    """
    super().reset()
    mjw.reset_data_keyframe(
        self.mjw_model, self.mjw_data, self._neutral_keyframe_id
    )

set_actuator_inputs(fly_name, actuator_type, inputs)

Set control inputs for all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
actuator_type ActuatorType

Type of actuator to control.

required
inputs Float[ndarray | array, 'n_worlds n_actuators']

Control inputs, shape (n_worlds, n_actuators), ordered as in fly.get_actuated_jointdofs_order(actuator_type). Accepts numpy or Warp arrays.

required
Source code in src/flygym/warp/simulation.py
@override
def set_actuator_inputs(
    self,
    fly_name: str,
    actuator_type: ActuatorType,
    inputs: Float[np.ndarray | wp.array, "n_worlds n_actuators"],
) -> None:
    """Set control inputs for all parallel worlds.

    Args:
        fly_name: Name of the fly.
        actuator_type: Type of actuator to control.
        inputs: Control inputs, shape ``(n_worlds, n_actuators)``, ordered as in
            ``fly.get_actuated_jointdofs_order(actuator_type)``. Accepts numpy or
            Warp arrays.
    """
    if not isinstance(inputs, wp.array):
        inputs = wp.array(inputs, dtype=wp.float32)
    indices = self._wp_intern_actuatorids_by_type_by_fly[actuator_type][fly_name]
    wp.launch(
        wp_scatter_indexed_cols_2d,
        dim=(self.n_worlds, indices.size),
        inputs=[inputs, self.mjw_data.ctrl, indices],
    )

set_leg_adhesion_states(fly_name, leg_to_adhesion_state)

Set adhesion states for each leg across all parallel worlds.

Parameters:

Name Type Description Default
fly_name str

Name of the fly.

required
leg_to_adhesion_state Float[ndarray | array, 'n_worlds 6']

Adhesion control array, shape (n_worlds, 6), ordered as in fly.get_legs_order(). Values should be in the range [0, 1]. Accepts numpy or Warp arrays.

required
Source code in src/flygym/warp/simulation.py
@override
def set_leg_adhesion_states(
    self,
    fly_name: str,
    leg_to_adhesion_state: Float[np.ndarray | wp.array, "n_worlds 6"],
) -> None:
    """Set adhesion states for each leg across all parallel worlds.

    Args:
        fly_name: Name of the fly.
        leg_to_adhesion_state: Adhesion control array, shape ``(n_worlds, 6)``,
            ordered as in ``fly.get_legs_order()``. Values should be in the range
            ``[0, 1]``. Accepts numpy or Warp arrays.
    """
    if not isinstance(leg_to_adhesion_state, wp.array):
        leg_to_adhesion_state = wp.array(leg_to_adhesion_state, dtype=wp.float32)
    indices = self._wp_intern_adhesionactuatorids_by_fly[fly_name]
    wp.launch(
        wp_scatter_indexed_cols_2d,
        dim=(self.n_worlds, indices.size),
        inputs=[leg_to_adhesion_state, self.mjw_data.ctrl, indices],
    )

set_renderer(cameras, *, camera_res=(240, 320), playback_speed=0.2, output_fps=25, buffer_frames=True, scene_option=None, worlds=None, use_gpu_batch_rendering=False, **kwargs)

Attach a renderer to this GPU simulation.

Parameters:

Name Type Description Default
cameras str | MjsCamera | list[str | MjsCamera]

Camera(s) to render.

required
camera_res tuple[int, int]

(height, width) in pixels.

(240, 320)
playback_speed float

Video playback speed relative to real time.

0.2
output_fps int

Output video frame rate.

25
buffer_frames bool

If True, store rendered frames in memory.

True
scene_option MjvOption | None

MuJoCo scene options. Uses defaults if None.

None
worlds list[int] | None

Indices of worlds to render. Defaults to all worlds.

None
use_gpu_batch_rendering bool

If True, use WarpGPUBatchRenderer; otherwise use WarpCPURenderer.

False
**kwargs Any

Passed to the renderer.

{}

Returns:

Type Description
WarpGPUBatchRenderer | WarpCPURenderer

The created renderer instance.

Source code in src/flygym/warp/simulation.py
@override
def set_renderer(
    self,
    cameras: str | mj.MjsCamera | list[str | mj.MjsCamera],
    *,
    camera_res: tuple[int, int] = (240, 320),
    playback_speed: float = 0.2,
    output_fps: int = 25,
    buffer_frames: bool = True,
    scene_option: mj.MjvOption | None = None,
    worlds: list[int] | None = None,
    use_gpu_batch_rendering: bool = False,
    **kwargs: Any,
) -> WarpGPUBatchRenderer | WarpCPURenderer:
    """Attach a renderer to this GPU simulation.

    Args:
        cameras: Camera(s) to render.
        camera_res: ``(height, width)`` in pixels.
        playback_speed: Video playback speed relative to real time.
        output_fps: Output video frame rate.
        buffer_frames: If True, store rendered frames in memory.
        scene_option: MuJoCo scene options. Uses defaults if None.
        worlds: Indices of worlds to render. Defaults to all worlds.
        use_gpu_batch_rendering: If True, use `WarpGPUBatchRenderer`;
            otherwise use `WarpCPURenderer`.
        **kwargs: Passed to the renderer.

    Returns:
        The created renderer instance.
    """
    if worlds is None:
        worlds = list(range(self.n_worlds))
    self.use_gpu_batch_rendering = use_gpu_batch_rendering

    renderer_kwargs = {
        "mj_model": self.mj_model,
        "n_worlds_total": self.n_worlds,
        "cameras": cameras,
        "camera_res": camera_res,
        "playback_speed": playback_speed,
        "output_fps": output_fps,
        "buffer_frames": buffer_frames,
        "scene_option": scene_option,
        "worlds": worlds,
        **kwargs,
    }
    if use_gpu_batch_rendering:
        is_model_modified = modify_world_for_batch_rendering(self.world)
        if is_model_modified:
            warnings.warn(
                "The world was modified to be compatible with GPU batch rendering. "
                "Recompiling the model."
            )
            # Carry option overrides over to the recompiled model
            timestep = self.mj_model.opt.timestep
            tolerance = self.mj_model.opt.tolerance
            self.mj_model, self.mj_data = self.world.compile()
            self._apply_option_overrides(timestep=timestep, tolerance=tolerance)
            self._neutral_keyframe_id = mj.mj_name2id(
                self.mj_model, mj.mjtObj.mjOBJ_KEY, "neutral"
            )
            mj.mj_resetDataKeyframe(
                self.mj_model, self.mj_data, self._neutral_keyframe_id
            )
            self.mjw_model, self.mjw_data = self._mj_structs_to_mjw_structs()
            renderer_kwargs["mj_model"] = self.mj_model
        self.renderer = WarpGPUBatchRenderer(**renderer_kwargs)
    else:
        self.renderer = WarpCPURenderer(**renderer_kwargs)

    return self.renderer

set_state(qpos=None, qvel=None, worlds_mask=None)

Directly set generalized positions and/or velocities for parallel worlds.

Unlike reset, which restores the single neutral keyframe to every (masked) world, this writes a possibly different qpos/qvel per world. It is the building block for reference-state initialization, where each world starts an episode from a different reference pose.

Parameters:

Name Type Description Default
qpos Float[ndarray | array, 'n_worlds nq'] | None

Optional generalized positions, shape (n_worlds, nq). Accepts numpy or Warp arrays. If None, positions are left unchanged.

None
qvel Float[ndarray | array, 'n_worlds nv'] | None

Optional generalized velocities, shape (n_worlds, nv). Accepts numpy or Warp arrays. If None, velocities are left unchanged.

None
worlds_mask array | ndarray | None

Optional per-world boolean mask, shape (n_worlds,). Only masked worlds are written; the rest keep their current state. Defaults to all worlds.

None

Warning

Like reset, this does not update derived kinematic quantities (xpos, xquat, site_xpos, velocities, ...). Call forward (or step) before reading them, otherwise getters return stale pre-write values.

Source code in src/flygym/warp/simulation.py
def set_state(
    self,
    qpos: Float[np.ndarray | wp.array, "n_worlds nq"] | None = None,
    qvel: Float[np.ndarray | wp.array, "n_worlds nv"] | None = None,
    worlds_mask: wp.array | np.ndarray | None = None,
) -> None:
    """Directly set generalized positions and/or velocities for parallel worlds.

    Unlike `reset`, which restores the single neutral keyframe to every (masked)
    world, this writes a possibly different `qpos`/`qvel` per world. It is the
    building block for reference-state initialization, where each world starts an
    episode from a different reference pose.

    Args:
        qpos: Optional generalized positions, shape ``(n_worlds, nq)``. Accepts
            numpy or Warp arrays. If None, positions are left unchanged.
        qvel: Optional generalized velocities, shape ``(n_worlds, nv)``. Accepts
            numpy or Warp arrays. If None, velocities are left unchanged.
        worlds_mask: Optional per-world boolean mask, shape ``(n_worlds,)``. Only
            masked worlds are written; the rest keep their current state. Defaults
            to all worlds.

    !!! warning

        Like `reset`, this does not update derived kinematic quantities (`xpos`,
        `xquat`, `site_xpos`, velocities, ...). Call `forward` (or `step`) before
        reading them, otherwise getters return stale pre-write values.
    """
    if qpos is None and qvel is None:
        return
    if worlds_mask is None:
        mask = wp.ones(self.n_worlds, dtype=wp.bool)
    elif isinstance(worlds_mask, wp.array):
        mask = worlds_mask
    else:
        mask = wp.array(worlds_mask, dtype=wp.bool)
    if mask.shape != (self.n_worlds,):
        raise ValueError(
            f"`worlds_mask` must have shape ({self.n_worlds},), got {mask.shape}."
        )
    for name, src, dst in (
        ("qpos", qpos, self.mjw_data.qpos),
        ("qvel", qvel, self.mjw_data.qvel),
    ):
        if src is None:
            continue
        if isinstance(src, wp.array):
            if src.dtype != wp.float32:
                raise TypeError(
                    f"`{name}` must be a float32 Warp array, got dtype "
                    f"{wp.types.type_repr(src.dtype)}."
                )
        else:
            src = wp.array(src, dtype=wp.float32)
        if src.shape != dst.shape:
            raise ValueError(
                f"`{name}` must have shape {dst.shape}, got {src.shape}."
            )
        wp.launch(
            wp_masked_copy_rows_2d,
            dim=dst.shape,
            inputs=[src, dst, mask],
        )

set_trajectory_recorder(*, playback_speed=0.2, output_fps=25, worlds=None)

Attach a recorder that stores the kinematic state at the video frame rate.

The recorded trajectories can be rendered to video later with flygym.warp.recording.render_trajectories_gpu or flygym.recording.render_trajectories. See flygym.recording for details. The recorder is independent of the renderer: either or both can be attached.

Parameters:

Name Type Description Default
playback_speed float

Video playback speed relative to real time.

0.2
output_fps int

Output video frame rate.

25
worlds list[int] | None

Indices of worlds to record. Defaults to all worlds.

None

Returns:

Type Description
WarpTrajectoryRecorder

The created WarpTrajectoryRecorder instance.

Source code in src/flygym/warp/simulation.py
@override
def set_trajectory_recorder(
    self,
    *,
    playback_speed: float = 0.2,
    output_fps: int = 25,
    worlds: list[int] | None = None,
) -> WarpTrajectoryRecorder:
    """Attach a recorder that stores the kinematic state at the video frame rate.

    The recorded trajectories can be rendered to video later with
    `flygym.warp.recording.render_trajectories_gpu` or
    `flygym.recording.render_trajectories`. See `flygym.recording` for details. The
    recorder is independent of the renderer: either or both can be attached.

    Args:
        playback_speed: Video playback speed relative to real time.
        output_fps: Output video frame rate.
        worlds: Indices of worlds to record. Defaults to all worlds.

    Returns:
        The created `WarpTrajectoryRecorder` instance.
    """
    self.recorder = WarpTrajectoryRecorder(
        self.mj_model,
        self.n_worlds,
        worlds=worlds,
        playback_speed=playback_speed,
        output_fps=output_fps,
    )
    return self.recorder

step()

Advance all parallel worlds by one timestep on the GPU.

Source code in src/flygym/warp/simulation.py
@override
def step(self) -> None:
    """Advance all parallel worlds by one timestep on the GPU."""
    mjw.step(self.mjw_model, self.mjw_data)