visionOS panning and zooming gestures broken when rotating the map in a 3D volume

[eurobob]

Environment

• Xcode version: 15.4
• visionOS version: 2.0
• Devices affected: Vision Pro
• Maps SDK Version: 11.6.1

Observed behavior and steps to reproduce

In visionOS, I'm trying to apply a 3d rotation effect to have the map take up the space on the "floor" of a volume, but when i do this, the drag and zoom gestures become unusable. A small movement makes the panning go haywire and it infinitely scrolls as fast as possible. There is no control at all.

import SwiftUI
import RealityKit
import RealityKitContent
@_spi(Experimental) import MapboxMaps

struct VolumeView: View {
    init() {
        MapboxOptions.accessToken = "<redacted>"
    }
    var body: some View {
        GeometryReader3D { geometry in
            MapboxMapView()
                .ignoresSafeArea()
                 .rotation3DEffect(
                     .degrees(90),
                     axis: (x: 1.0, y: 0.0, z: 0.0)
                 )
                 .offset(z: geometry.size.depth / 2)
                 .offset(y: geometry.size.height / 2)
        }
    }

}

struct MapboxMapView: UIViewRepresentable {
    private let arrifana = CLLocationCoordinate2D(latitude: 37.292182, longitude: -8.863332)
    
    func makeUIView(context: Context) -> MapView {
        let gestureOptions = GestureOptions(pitchEnabled: false)
        let cameraOptions = CameraOptions(center: arrifana, zoom: 10, pitch: 70)
        
        let mapView = MapView(frame: .zero)
        mapView.mapboxMap.setCamera(to: cameraOptions)
        mapView.gestures.options = gestureOptions
        
        return mapView
    }
    
    func updateUIView(_ uiView: MapView, context: Context) {}
}

#Preview(windowStyle: .automatic) {
    VolumeView()
}

Expected behavior

Drag and zoom behaviour should be consistent regardless of 3D translation of the Map View

[eurobob]

After some more testing, I notice that if I set the angle to 45 degrees it is more responsive. Up to 75-85 degrees it starts to get a bit weird.

I notice that I still have to pan with a vertical motion in the air, instead of horizontally, which isn't very user friendly. Do i need to translate the gestures in some way?

[jelemans]

this also happens without mapboxMaps. Straight Mapkit, same problem.