Following up on the PlayStation 4 Eye / PS4 Camera Teardown and PS4Eye: PS4 Eye Camera Tools and PlayStation 4 USB Comm Dump, today PlayStation 4 developer bigboss (PSXDEV on Twitter) made available PS4EyeCam (aka OrbisEyeCam) which is a PS4 Camera PC driver for the PS4 Dual Eye.
Download: PS4EYECam / GIT / OrbisEyeCam / GIT / PS4Cam_ja fork via fanjinfei / PS4 CAMERA DRIVERS fork (includes ucrtbased.dll) via Hackinside
To quote: PS4EYECam released
I had released the first public version of PS4EYECam driver. You can get full information in my PS4EYECam repository.
It is the first public driver for PlayStation 4 Camera licensed under gpl. I have free afternoons available if someone is interested to offer me a partial job
Enjoy and remember the best is yet to come...
What is PS4EYECam?
PlayStation 4 Camera has a Sony propietary connector called AUX, it is an USB 3 connector without USB 2 differential data pair (d+ and d-). If you want to use it on other platform different than PlayStation 4 console you must adapt wire and connector to USB 3.
It is based on:
USB descriptor when firmware is loaded
Supported platforms
PS4EYECam is a USB 3 device and it is using libusb so it can be ported to all platforms supported by libusb and with USB 3 controllers.
Implementation reference was done in OSX Mavericks and i only tested it on this platform.
OSX Mavericks
A sample PS4EYECapture with PS4EYECam tested on OSX Maverick is included using:
2) Choose ciUI block and option copy
3) Choose OpenCV block and option relative
4) Choose finish and project is created choose xcode project file and open it
5) Clone PS4EYECam repository
6) Copy driver/src/*.cpp to your PS4EYECapture/src
7) Copy cinder/src/*.cpp to your PS4EYECapture/src
8) Copy driver/include/*.h to your PS4EYECapture/include
9) Copy cinder/resources/firmware.bin to your PS4EYECapture/resources
10) Copy /opt/local/inclide/libusb-1.0/libusb.h to your PS4EYECapture/include
11) Copy /opt/local/lib/libusb-1.0.0.dylib to your cinder_master/lib/macosx/
12) Incorporate cpp files from driver/src and cinder/src on src, firmware.bin to resources headers files to include and libusb lib.
13) Ready to compile and run
TODO LIST
What does this do?
Check https://psxdev.github.io/luke2.html
How do I use it?
1. Install Usb Boot device driver using InstallDriver.exe from bin directory
2. Upload firmware, i included last firmware from 6.50 with md5 24afe3c941dc599aafd23ac5170a4d14 check https://psxdev.github.io/luke.html
3. Usb Camera-OV580 ready to use with Windows Media Framework
Finally, from the forked README.md: PS4-CAMERA-DRIVERS
Windows drivers (WIP)
Same as https://github.com/psxdev/OrbisEyeCam/tree/master/bin but with missing DLL attached.
Original repository: https://github.com/psxdev/OrbisEyeCam
Download: PS4EYECam / GIT / OrbisEyeCam / GIT / PS4Cam_ja fork via fanjinfei / PS4 CAMERA DRIVERS fork (includes ucrtbased.dll) via Hackinside
To quote: PS4EYECam released
I had released the first public version of PS4EYECam driver. You can get full information in my PS4EYECam repository.
It is the first public driver for PlayStation 4 Camera licensed under gpl. I have free afternoons available if someone is interested to offer me a partial job
Enjoy and remember the best is yet to come...
What is PS4EYECam?
- PS4EYECam is a Sony PlayStation 4 Camera driver implementation reference.
- The driver is using libusb (github.com/libusb/libusb) to handle USB communications.
- Part of code was based on PS3EYEDriver (github.com/inspirit/PS3EYEDriver).
- Payload parsing stuff parts from Linux kernel source (gspca).
- UVC video control from libuvc (github.com/ktossell/libuvc).
- Boot and initialization from dumped PlayStation 4 Camera firmware ps4eye (github.com/ps4eye/ps4eye).
- Other parts and research based on my experience adding support for different usb devices for Sony PlayStation 2 and Sony PlayStation 3 consoles (ps2eyetoy.irx, ps2mic.irx, ps3kinect.sprx, etc).
PlayStation 4 Camera has a Sony propietary connector called AUX, it is an USB 3 connector without USB 2 differential data pair (d+ and d-). If you want to use it on other platform different than PlayStation 4 console you must adapt wire and connector to USB 3.
It is based on:
Code:
OV580 asic from Omnivision is a usb bridge and control all other chips.
OV9713 cmos sensor camera from omnivision. It has 2.
5703 A/D converter from AKM.
4g51A eeprom sop-j8 package from ROHM?
...
Code:
Bus 004 Device 002: ID 05a9:058a OmniVision Technologies, Inc.
Device Descriptor:
bLength 18
bDescriptorType 1
bcdUSB 3.00
bDeviceClass 239 Miscellaneous Device
bDeviceSubClass 2 ?
bDeviceProtocol 1 Interface Association
bMaxPacketSize0 9
idVendor 0x05a9 OmniVision Technologies, Inc.
idProduct 0x058a
bcdDevice 1.00
iManufacturer 1 Omnivision Technologies, Inc.
iProduct 2 USB Camera-OV580
iSerial 0
bNumConfigurations 1
Configuration Descriptor:
bLength 9
bDescriptorType 2
wTotalLength 311
bNumInterfaces 2
bConfigurationValue 1
iConfiguration 0
bmAttributes 0x80
(Bus Powered)
MaxPower 128mA
Interface Association:
bLength 8
bDescriptorType 11
bFirstInterface 0
bInterfaceCount 2
bFunctionClass 14 Video
bFunctionSubClass 3 Video Interface Collection
bFunctionProtocol 0
iFunction 2 USB Camera-OV580
Interface Descriptor:
bLength 9
bDescriptorType 4
bInterfaceNumber 0
bAlternateSetting 0
bNumEndpoints 0
bInterfaceClass 14 Video
bInterfaceSubClass 1 Video Control
bInterfaceProtocol 0
iInterface 2 USB Camera-OV580
VideoControl Interface Descriptor:
bLength 13
bDescriptorType 36
bDescriptorSubtype 1 (HEADER)
bcdUVC 1.00
wTotalLength 77
dwClockFrequency 125.000000MHz
bInCollection 1
baInterfaceNr( 0) 1
VideoControl Interface Descriptor:
bLength 18
bDescriptorType 36
bDescriptorSubtype 2 (INPUT_TERMINAL)
bTerminalID 1
wTerminalType 0x0201 Camera Sensor
bAssocTerminal 0
iTerminal 0
wObjectiveFocalLengthMin 0
wObjectiveFocalLengthMax 0
wOcularFocalLength 0
bControlSize 3
bmControls 0x0000000a
Auto-Exposure Mode
Exposure Time (Absolute)
VideoControl Interface Descriptor:
bLength 9
bDescriptorType 36
bDescriptorSubtype 3 (OUTPUT_TERMINAL)
bTerminalID 2
wTerminalType 0x0101 USB Streaming
bAssocTerminal 0
bSourceID 3
iTerminal 0
VideoControl Interface Descriptor:
bLength 11
bDescriptorType 36
bDescriptorSubtype 5 (PROCESSING_UNIT)
Warning: Descriptor too short
bUnitID 3
bSourceID 1
wMaxMultiplier 0
bControlSize 2
bmControls 0x0000165f
Brightness
Contrast
Hue
Saturation
Sharpness
White Balance Temperature
Gain
Power Line Frequency
White Balance Temperature, Auto
iProcessing 2 USB Camera-OV580
bmVideoStandards 0x1a
NTSC - 525/60
SECAM - 625/50
NTSC - 625/50
VideoControl Interface Descriptor:
bLength 26
bDescriptorType 36
bDescriptorSubtype 6 (EXTENSION_UNIT)
bUnitID 4
guidExtensionCode {8a0f88dd-ba1c-5449-8a25-f7875967f0f7}
bNumControl 1
bNrPins 1
baSourceID( 0) 1
bControlSize 1
bmControls( 0) 0x01
iExtension 2 USB Camera-OV580
Interface Descriptor:
bLength 9
bDescriptorType 4
bInterfaceNumber 1
bAlternateSetting 0
bNumEndpoints 0
bInterfaceClass 14 Video
bInterfaceSubClass 2 Video Streaming
bInterfaceProtocol 0
iInterface 0
VideoStreaming Interface Descriptor:
bLength 14
bDescriptorType 36
bDescriptorSubtype 1 (INPUT_HEADER)
bNumFormats 1
wTotalLength 177
bEndPointAddress 129
bmInfo 0
bTerminalLink 2
bStillCaptureMethod 0
bTriggerSupport 0
bTriggerUsage 0
bControlSize 1
bmaControls( 0) 27
VideoStreaming Interface Descriptor:
bLength 27
bDescriptorType 36
bDescriptorSubtype 4 (FORMAT_UNCOMPRESSED)
bFormatIndex 1
bNumFrameDescriptors 3
guidFormat {59555932-0000-1000-8000-00aa00389b71}
bBitsPerPixel 16
bDefaultFrameIndex 1
bAspectRatioX 0
bAspectRatioY 0
bmInterlaceFlags 0x00
Interlaced stream or variable: No
Fields per frame: 2 fields
Field 1 first: No
Field pattern: Field 1 only
bCopyProtect 0
VideoStreaming Interface Descriptor:
bLength 42
bDescriptorType 36
bDescriptorSubtype 5 (FRAME_UNCOMPRESSED)
bFrameIndex 1
bmCapabilities 0x00
Still image unsupported
wWidth 3448
wHeight 808
dwMinBitRate 5571968
dwMaxBitRate 167159040
dwMaxVideoFrameBufferSize 5571968
dwDefaultFrameInterval 166666
bFrameIntervalType 4
dwFrameInterval( 0) 166666
dwFrameInterval( 1) 333333
dwFrameInterval( 2) 666666
dwFrameInterval( 3) 1250000
VideoStreaming Interface Descriptor:
bLength 46
bDescriptorType 36
bDescriptorSubtype 5 (FRAME_UNCOMPRESSED)
bFrameIndex 2
bmCapabilities 0x00
Still image unsupported
wWidth 1748
wHeight 408
dwMinBitRate 1426368
dwMaxBitRate 42791040
dwMaxVideoFrameBufferSize 1426368
dwDefaultFrameInterval 83333
bFrameIntervalType 5
dwFrameInterval( 0) 83333
dwFrameInterval( 1) 166666
dwFrameInterval( 2) 333333
dwFrameInterval( 3) 666666
dwFrameInterval( 4) 1250000
VideoStreaming Interface Descriptor:
bLength 42
bDescriptorType 36
bDescriptorSubtype 5 (FRAME_UNCOMPRESSED)
bFrameIndex 3
bmCapabilities 0x00
Still image unsupported
wWidth 898
wHeight 200
dwMinBitRate 359200
dwMaxBitRate 10776000
dwMaxVideoFrameBufferSize 359200
dwDefaultFrameInterval 41666
bFrameIntervalType 4
dwFrameInterval( 0) 41666
dwFrameInterval( 1) 83333
dwFrameInterval( 2) 166666
dwFrameInterval( 3) 333333
VideoStreaming Interface Descriptor:
bLength 6
bDescriptorType 36
bDescriptorSubtype 13 (COLORFORMAT)
bColorPrimaries 1 (BT.709,sRGB)
bTransferCharacteristics 1 (BT.709)
bMatrixCoefficients 4 (SMPTE 170M (BT.601))
Interface Descriptor:
bLength 9
bDescriptorType 4
bInterfaceNumber 1
bAlternateSetting 1
bNumEndpoints 1
bInterfaceClass 14 Video
bInterfaceSubClass 2 Video Streaming
bInterfaceProtocol 0
iInterface 0
Endpoint Descriptor:
bLength 7
bDescriptorType 5
bEndpointAddress 0x81 EP 1 IN
bmAttributes 5
Transfer Type Isochronous
Synch Type Asynchronous
Usage Type Data
wMaxPacketSize 0x0400 1x 1024 bytes
bInterval 1
bMaxBurst 15
Mult 2
Binary Object Store Descriptor:
bLength 5
bDescriptorType 15
wTotalLength 22
bNumDeviceCaps 2
USB 2.0 Extension Device Capability:
bLength 7
bDescriptorType 16
bDevCapabilityType 2
bmAttributes 0x00000002
Link Power Management (LPM) Supported
SuperSpeed USB Device Capability:
bLength 10
bDescriptorType 16
bDevCapabilityType 3
bmAttributes 0x00
wSpeedsSupported 0x000c
Device can operate at High Speed (480Mbps)
Device can operate at SuperSpeed (5Gbps)
bFunctionalitySupport 2
Lowest fully-functional device speed is High Speed (480Mbps)
bU1DevExitLat 10 micro seconds
bU2DevExitLat 32 micro seconds
Device Status: 0x0f0c
(Bus Powered)
U1 Enabled
U2 Enabled
information interesting about usb 2 superspeed
USB 3.0 Endpoint Companion:
bMaxBurst: 15
bmAttributes: 0x02
wBytesPerInterval: 49152
Interface 1 alt setting 0 describe all video modes see uvc_set_video(uint8_t mode,uint8_t fps) function with these possible options:
mode 0 fps 60(default), 30, 15, 8 video and depth frames 1280x800
mode 1 fps 120(default), 60, 30, 15, 8 video and depth frames 640x400
mode 2 fps 240(default), 120, 60, 30 video and depth frames 320x192
device frame format:
mode 0 3448x2x808 bytes frame each row:
unknown1 32 bytes
unknown2 64 bytes
video 1280x2 bytes
depth 1280x2 bytes
unknow3 840x2 bytes
mode 1 1748x2x408 bytes frame each row:
unknown1 32 bytes
unknown2 64 bytes
video 1280x2 byetes
depth 1280x2 bytes
unknow3 420x2 bytes
mode 2 898x2x200 bytes frame each row
unknown1 32 bytes
unknown2 64 bytes
video 320x2 bytes
depth 320x2 bytes
unknown3 210x2 bytesPS4EYECam is a USB 3 device and it is using libusb so it can be ported to all platforms supported by libusb and with USB 3 controllers.
Implementation reference was done in OSX Mavericks and i only tested it on this platform.
OSX Mavericks
A sample PS4EYECapture with PS4EYECam tested on OSX Maverick is included using:
- libcinder (github.com/cinder/Cinder).
- ciUI (github.com/bigboss-ps3dev/ciUI) With little modification to use in Mavericks environment.
- opencv-cinder (github.com/cinder/Cinder-OpenCV) For future use.
- xcode
- macport or similar
- libusb (with macport is installed in /local/opt/lib)
Code:
$ pwd
/opt/local/lib
$ ls -l libusb-1.0.*
-rwxr-xr-x 1 root admin 190412 11 sep 22:17 libusb-1.0.0.dylib
-rw-r--r-- 1 root admin 244528 11 sep 22:17 libusb-1.0.a
lrwxr-xr-x 1 root admin 18 11 sep 22:17 libusb-1.0.dylib -> libusb-1.0.0.dylib- Compile and install libcinder (github.com/cinder/Cinder) follow gitsetup (libcinder.org/docs/welcome/GitSetup.html).
- Install ciUI and Cinder-OpenCV blocks
Code:
$ pwd
/[YOUR_OWN_PATH]/cinder_master
$ cd blocks
$ git clone https://github.com/bigboss-ps3dev/ciUI
$ git clone https://github.com/cinder/Cinder-OpenCV- Use TinderBox-Mac tool to create a PS4EYECapture project /[YOUR_OWN_PATH]/cinder_master/tools/TinderBox-Mac
2) Choose ciUI block and option copy
3) Choose OpenCV block and option relative
4) Choose finish and project is created choose xcode project file and open it
5) Clone PS4EYECam repository
Code:
git clone https://github.com/bigboss-ps3dev/PS4EYECam7) Copy cinder/src/*.cpp to your PS4EYECapture/src
8) Copy driver/include/*.h to your PS4EYECapture/include
9) Copy cinder/resources/firmware.bin to your PS4EYECapture/resources
10) Copy /opt/local/inclide/libusb-1.0/libusb.h to your PS4EYECapture/include
11) Copy /opt/local/lib/libusb-1.0.0.dylib to your cinder_master/lib/macosx/
12) Incorporate cpp files from driver/src and cinder/src on src, firmware.bin to resources headers files to include and libusb lib.
13) Ready to compile and run
TODO LIST
- Identify uknown1, unknown2 and unknown3 formats
- Identify correct format to depth frame. Sample only use threshold values to display results in rgb
- Port driver to other platforms (Linux , Windows, ...)
- Cinder is only supported by OSX and windows. An openframework sample can be done easily and it is multiplatform
- Fix, improve, incorporate new features
- If someone has ov580 datasheet contact (twitter @psxdev) with me please
What does this do?
Check https://psxdev.github.io/luke2.html
How do I use it?
1. Install Usb Boot device driver using InstallDriver.exe from bin directory
2. Upload firmware, i included last firmware from 6.50 with md5 24afe3c941dc599aafd23ac5170a4d14 check https://psxdev.github.io/luke.html
Code:
git clone https://github.com/psxdev/OrbisEyeCam
cd OrbisEyeCam
cd bin
OrbisEyeCameraFirmwareLoader.exe
Found OrbisEyeCam UsbBoot mode
Uploading firmware to ov580 camera...
Firmware uploaded...
OrbisEyeCam destructor
OrbisEyeCam release called
closing device
device closedFinally, from the forked README.md: PS4-CAMERA-DRIVERS
Windows drivers (WIP)
Same as https://github.com/psxdev/OrbisEyeCam/tree/master/bin but with missing DLL attached.
Original repository: https://github.com/psxdev/OrbisEyeCam
