七麦数据

MusiKraken is a modular MIDI Controller Construction Kit, empowering you to fully harness the capabilities of your mobile device's hardware.

Winner of a 2022 MIDI Innovation Award!

Make music using device sensors like Touch, Motion Sensors, Camera (face, hand, body and color tracking, including TrueDepth and LiDAR support) and Microphone, or connected devices like Game Controllers, Apple Watch or AirPods.

Choose from several types of modules in the editor and connect the ports to create your own personal MIDI controller setup. Route the MIDI signals through effect modules to control multiple instruments simultaneously or invent creative new MIDI controller combinations.

MusiKraken supports sending and receiving MIDI data over Wi-Fi, Bluetooth or via Core MIDI (for example by using Inter-Device Audio and MIDI (IDAM)). And it can host Audio Unit (AUv3) instrument plugins. Or send the sensor data via OSC. MusiKraken is also one of the first apps to officially support MIDI 2.0!

You already own a very powerful device with all kinds of sensors and connection possibilities. With this app you can use these sensors as inputs, combine them with all kinds of MIDI effects and send the resulting MIDI events to your computer, synthesizer, any other MIDI-capable app or Audio Unit to to create your own, expressive MIDI controller setup.

Your device for example has a multitouch screen. Use this with the Keyboard module to slide on the keys to control multiple musical parameters simultaneously. Using MPE, MIDI 2.0 or the Chord Splitter also allows you to control these parameters separately per key. Newer devices also support tracking the finger radius (or pressure on older devices), which adds another dimension of control. Multitouch is also used by the Chords Pad to play the chords of a selected scale, or the Touchpad, which allows you control values via touch gestures.

Another unique input sensor is the camera: MusiKraken supports tracking your hands in front of the camera, your body pose, your face or objects with specific colors. This way you can for example use your iOS device as a Theremin, jump or dance around in front of the camera to generate notes or control audio parameters, use your mouth to control the sound of a virtual trumpet, or any other combination. If your device has a TrueDepth or LiDAR sensor, you can also use the distances as input values.

Your device also has motion sensors: Accelerometer, Gyroscope and Magnetometer. They can be either used separately, or combined to get the current rotation of the device in three dimensions. Use this to generate sounds or control parameters while shaking or tilting your device.

Your device also has a microphone, and MusiKraken can detect the pitch or amplitude of the signal.

Your iOS device also allows you to connect to external devices. MusiKraken for example supports Game Controllers (trigger events on button or thumbstick changes, motion sensors, haptics and light on supported Game Controllers), Apple Watch (motion sensors, digital crown, touch, heart rate) or the motion sensors within AirPods.

The real power comes once you start combining the sensors with the effect modules. There are effects that can be used to change or filter the MIDI events. Some effects allow you to combine multiple input sources into new output values. Or splits chords into separate notes so that they can be sent to different channels.

Important: Please note that some of the modules only work on iOS devices with specific hardware: ARKit Face Tracking and the TrueDepth module need a TrueDepth front camera, and Hand and Body Pose Tracking needs at least iOS 14, and might be too slow on older devices.

HealthKit is used in the app to access Apple Watch data like heart beat or motion sensors. The app only uses sensor data to generate MIDI events.

MusiKraken is a modular MIDI Controller Construction Kit, empowering you to fully harness the capabilities of your mobile device's hardware.

Winner of a 2022 MIDI Innovation Award!

Make music using device sensors like Touch, Motion Sensors, Camera (face, hand, body and color tracking, including TrueDepth and LiDAR support) and Microphone, or connected devices like Game Controllers, Apple Watch or AirPods.

Choose from several types of modules in the editor and connect the ports to create your own personal MIDI controller setup. Route the MIDI signals through effect modules to control multiple instruments simultaneously or invent creative new MIDI controller combinations.

MusiKraken supports sending and receiving MIDI data over Wi-Fi, Bluetooth or via Core MIDI (for example by using Inter-Device Audio and MIDI (IDAM)). And it can host Audio Unit (AUv3) instrument plugins. Or send the sensor data via OSC. MusiKraken is also one of the first apps to officially support MIDI 2.0!

You already own a very powerful device with all kinds of sensors and connection possibilities. With this app you can use these sensors as inputs, combine them with all kinds of MIDI effects and send the resulting MIDI events to your computer, synthesizer, any other MIDI-capable app or Audio Unit to to create your own, expressive MIDI controller setup.

Your device for example has a multitouch screen. Use this with the Keyboard module to slide on the keys to control multiple musical parameters simultaneously. Using MPE, MIDI 2.0 or the Chord Splitter also allows you to control these parameters separately per key. Newer devices also support tracking the finger radius (or pressure on older devices), which adds another dimension of control. Multitouch is also used by the Chords Pad to play the chords of a selected scale, or the Touchpad, which allows you control values via touch gestures.

Another unique input sensor is the camera: MusiKraken supports tracking your hands in front of the camera, your body pose, your face or objects with specific colors. This way you can for example use your iOS device as a Theremin, jump or dance around in front of the camera to generate notes or control audio parameters, use your mouth to control the sound of a virtual trumpet, or any other combination. If your device has a TrueDepth or LiDAR sensor, you can also use the distances as input values.

Your device also has motion sensors: Accelerometer, Gyroscope and Magnetometer. They can be either used separately, or combined to get the current rotation of the device in three dimensions. Use this to generate sounds or control parameters while shaking or tilting your device.

Your device also has a microphone, and MusiKraken can detect the pitch or amplitude of the signal.

Your iOS device also allows you to connect to external devices. MusiKraken for example supports Game Controllers (trigger events on button or thumbstick changes, motion sensors, haptics and light on supported Game Controllers), Apple Watch (motion sensors, digital crown, touch, heart rate) or the motion sensors within AirPods.

The real power comes once you start combining the sensors with the effect modules. There are effects that can be used to change or filter the MIDI events. Some effects allow you to combine multiple input sources into new output values. Or splits chords into separate notes so that they can be sent to different channels.

Important: Please note that some of the modules only work on iOS devices with specific hardware: ARKit Face Tracking and the TrueDepth module need a TrueDepth front camera, and Hand and Body Pose Tracking needs at least iOS 14, and might be too slow on older devices.

HealthKit is used in the app to access Apple Watch data like heart beat or motion sensors. The app only uses sensor data to generate MIDI events.

MusiKraken is a modular MIDI Controller Construction Kit, empowering you to fully harness the capabilities of your mobile device's hardware.

Winner of a 2022 MIDI Innovation Award!

Make music using device sensors like Touch, Motion Sensors, Camera (face, hand, body and color tracking, including TrueDepth and LiDAR support) and Microphone, or connected devices like Game Controllers, Apple Watch or AirPods.

Choose from several types of modules in the editor and connect the ports to create your own personal MIDI controller setup. Route the MIDI signals through effect modules to control multiple instruments simultaneously or invent creative new MIDI controller combinations.

MusiKraken supports sending and receiving MIDI data over Wi-Fi, Bluetooth or via Core MIDI (for example by using Inter-Device Audio and MIDI (IDAM)). And it can host Audio Unit (AUv3) instrument plugins. Or send the sensor data via OSC. MusiKraken is also one of the first apps to officially support MIDI 2.0!

You already own a very powerful device with all kinds of sensors and connection possibilities. With this app you can use these sensors as inputs, combine them with all kinds of MIDI effects and send the resulting MIDI events to your computer, synthesizer, any other MIDI-capable app or Audio Unit to to create your own, expressive MIDI controller setup.

Your device for example has a multitouch screen. Use this with the Keyboard module to slide on the keys to control multiple musical parameters simultaneously. Using MPE, MIDI 2.0 or the Chord Splitter also allows you to control these parameters separately per key. Newer devices also support tracking the finger radius (or pressure on older devices), which adds another dimension of control. Multitouch is also used by the Chords Pad to play the chords of a selected scale, or the Touchpad, which allows you control values via touch gestures.

Another unique input sensor is the camera: MusiKraken supports tracking your hands in front of the camera, your body pose, your face or objects with specific colors. This way you can for example use your iOS device as a Theremin, jump or dance around in front of the camera to generate notes or control audio parameters, use your mouth to control the sound of a virtual trumpet, or any other combination. If your device has a TrueDepth or LiDAR sensor, you can also use the distances as input values.

Your device also has motion sensors: Accelerometer, Gyroscope and Magnetometer. They can be either used separately, or combined to get the current rotation of the device in three dimensions. Use this to generate sounds or control parameters while shaking or tilting your device.

Your device also has a microphone, and MusiKraken can detect the pitch or amplitude of the signal.

Your iOS device also allows you to connect to external devices. MusiKraken for example supports Game Controllers (trigger events on button or thumbstick changes, motion sensors, haptics and light on supported Game Controllers), Apple Watch (motion sensors, digital crown, touch, heart rate) or the motion sensors within AirPods.

The real power comes once you start combining the sensors with the effect modules. There are effects that can be used to change or filter the MIDI events. Some effects allow you to combine multiple input sources into new output values. Or splits chords into separate notes so that they can be sent to different channels.

Important: Please note that some of the modules only work on iOS devices with specific hardware: ARKit Face Tracking and the TrueDepth module need a TrueDepth front camera, and Hand and Body Pose Tracking needs at least iOS 14, and might be too slow on older devices.

HealthKit is used in the app to access Apple Watch data like heart beat or motion sensors. The app only uses sensor data to generate MIDI events.

MusiKraken is a modular MIDI Controller Construction Kit, empowering you to fully harness the capabilities of your mobile device's hardware.

Winner of a 2022 MIDI Innovation Award!

Make music using device sensors like Touch, Motion Sensors, Camera (face, hand, body and color tracking, including TrueDepth and LiDAR support) and Microphone, or connected devices like Game Controllers, Apple Watch or AirPods.

Choose from several types of modules in the editor and connect the ports to create your own personal MIDI controller setup. Route the MIDI signals through effect modules to control multiple instruments simultaneously or invent creative new MIDI controller combinations.

MusiKraken supports sending and receiving MIDI data over Wi-Fi, Bluetooth or via Core MIDI (for example by using Inter-Device Audio and MIDI (IDAM)). And it can host Audio Unit (AUv3) instrument plugins. Or send the sensor data via OSC. MusiKraken is also one of the first apps to officially support MIDI 2.0!

You already own a very powerful device with all kinds of sensors and connection possibilities. With this app you can use these sensors as inputs, combine them with all kinds of MIDI effects and send the resulting MIDI events to your computer, synthesizer, any other MIDI-capable app or Audio Unit to to create your own, expressive MIDI controller setup.

Your device for example has a multitouch screen. Use this with the Keyboard module to slide on the keys to control multiple musical parameters simultaneously. Using MPE, MIDI 2.0 or the Chord Splitter also allows you to control these parameters separately per key. Newer devices also support tracking the finger radius (or pressure on older devices), which adds another dimension of control. Multitouch is also used by the Chords Pad to play the chords of a selected scale, or the Touchpad, which allows you control values via touch gestures.

Another unique input sensor is the camera: MusiKraken supports tracking your hands in front of the camera, your body pose, your face or objects with specific colors. This way you can for example use your iOS device as a Theremin, jump or dance around in front of the camera to generate notes or control audio parameters, use your mouth to control the sound of a virtual trumpet, or any other combination. If your device has a TrueDepth or LiDAR sensor, you can also use the distances as input values.

Your device also has motion sensors: Accelerometer, Gyroscope and Magnetometer. They can be either used separately, or combined to get the current rotation of the device in three dimensions. Use this to generate sounds or control parameters while shaking or tilting your device.

Your device also has a microphone, and MusiKraken can detect the pitch or amplitude of the signal.

Your iOS device also allows you to connect to external devices. MusiKraken for example supports Game Controllers (trigger events on button or thumbstick changes, motion sensors, haptics and light on supported Game Controllers), Apple Watch (motion sensors, digital crown, touch, heart rate) or the motion sensors within AirPods.

The real power comes once you start combining the sensors with the effect modules. There are effects that can be used to change or filter the MIDI events. Some effects allow you to combine multiple input sources into new output values. Or splits chords into separate notes so that they can be sent to different channels.

Important: Please note that some of the modules only work on iOS devices with specific hardware: ARKit Face Tracking and the TrueDepth module need a TrueDepth front camera, and Hand and Body Pose Tracking needs at least iOS 14, and might be too slow on older devices.

HealthKit is used in the app to access Apple Watch data like heart beat or motion sensors. The app only uses sensor data to generate MIDI events.

MusiKraken is an Experimental MIDI Controller Construction Kit.

Winner of the 2022 MIDI Innovation Awards in the category "Software Prototypes / Non-Commercial Products".

Make music using device sensors like Touch, Accelerometer, Microphone and Camera (face, hand, body joint and color tracking and depth sensor support), or connected devices like Game Controllers or an Apple Watch.

Choose from several types of modules in the editor and connect the ports to create your own MIDI controller setup. Use Route the MIDI signals through effect modules to control multiple instruments simultaneously or generate creative combinations.

MusiKraken supports sending and receiving MIDI data over Wi-Fi, Bluetooth or via Core MIDI (for example by using Inter-Device Audio and MIDI (IDAM)). And it can host Audio Unit Instruments.

Important: Please note that some of the modules only work on iOS devices with specific hardware: ARKit Face Tracking and the TrueDepth module need a TrueDepth front camera, and Hand and Body Joint Tracking needs at least iOS 14, and might be too slow on older devices.

Input Modules:
-Keyboard: MPE support, scale highlighting, control multiple values by sliding and touch pressure or finger radius.
-Chords Pad: Play chords and its inversions of a selected scale.
-Touchpad: Slide multiple fingers on a touchpad to control up to 5 values simultaneously.
-ARKit Face Tracking: Uses the TrueDepth camera to generate notes or control parameters using your mouth, eyes, tongue or by moving your head.
-Mouth Tracking: Uses the normal camera to control parameters using your mouth.
-TrueDepth: Use the depth signal of your camera to generate MIDI data by moving your hand (or anything else) in front of the device.
-Hand Tracking: Uses the camera to convert your hand position and simple hand gestures to MIDI. You can use one or two hands and it can also use the TrueDepth sensor if available.
-Body Tracking: Uses the camera to track hand, feet and head positions of up to two persons.
-Color Tracking: Track objects by color.
-Motion Sensors: Uses the combination of Accelerometer, Gyroscope and Magnetometer to detect the current rotation of the device.
-Accelerometer: Measures the acceleration of the device.
-Apple Watch: Use the motion sensors, heart rate, touch and digital crown.
-Game Controller: Use buttons, thumbsticks and everything else.
-Microphone: Detects pitch and volume using the microphone.
-External Input Device: Receives MIDI events of connected input devices.

Output Modules:
-External Output Device: Send MIDI events to any device accessible via Core MIDI.
-AudioUnit: Load any Music Device or MIDI Processor Audio Unit and generate sounds directly in the app.
-Core MIDI Network: Send MIDI via WiFi.
-Snarp Network MIDI: My own implementation to send MIDI via WiFi.
-SimpleSynth: Generate simple synthesizer sounds directly on the device.

Effects:
-Chord Splitter: Splits incoming chords into separate notes and sends these to separate channels.
-Channel Switcher: Change the MIDI channel of events.
-Value to MIDI Converter: Converter to convert numerical values (green ports) to MIDI events (orange ports).
-Transposer: Transpose MIDI notes.
-Arpeggiator: Cycles through the notes of incoming chords in a specific pattern.
-Speed: Computes a new value based on the change speed of another value.
-Beat: Play a beat if a value is changed quickly.
-Threshold: Plays notes if a value goes over a specific threshold.
-LFO: Generates an LFO from incoming values.
-Envelope: Generates an ADSR output value based on note input.
-Latch: Keeps notes alive until the same note is played again.
-Filter: Filter events by channel, note, velocity or CC.

HealthKit is used in the app to access Apple Watch data like heart beat or motion sensors. The app only uses sensor data to generate MIDI events.

MusiKraken is an Experimental MIDI Controller Construction Kit.

Winner of the 2022 MIDI Innovation Awards in the category "Software Prototypes / Non-Commercial Products".

Make music using device sensors like Touch, Accelerometer, Microphone and Camera (face, hand, body joint and color tracking and depth sensor support), or connected devices like Game Controllers or an Apple Watch.

Choose from several types of modules in the editor and connect the ports to create your own MIDI controller setup. Use Route the MIDI signals through effect modules to control multiple instruments simultaneously or generate creative combinations.

MusiKraken supports sending and receiving MIDI data over Wi-Fi, Bluetooth or via Core MIDI (for example by using Inter-Device Audio and MIDI (IDAM)). And it can host Audio Unit Instruments.

Important: Please note that some of the modules only work on iOS devices with specific hardware: ARKit Face Tracking and the TrueDepth module need a TrueDepth front camera, and Hand and Body Joint Tracking needs at least iOS 14, and might be too slow on older devices.

Input Modules:
-Keyboard: MPE support, scale highlighting, control multiple values by sliding and touch pressure or finger radius.
-Chords Pad: Play chords and its inversions of a selected scale.
-Touchpad: Slide multiple fingers on a touchpad to control up to 5 values simultaneously.
-ARKit Face Tracking: Uses the TrueDepth camera to generate notes or control parameters using your mouth, eyes, tongue or by moving your head.
-Mouth Tracking: Uses the normal camera to control parameters using your mouth.
-TrueDepth: Use the depth signal of your camera to generate MIDI data by moving your hand (or anything else) in front of the device.
-Hand Tracking: Uses the camera to convert your hand position and simple hand gestures to MIDI. You can use one or two hands and it can also use the TrueDepth sensor if available.
-Body Tracking: Uses the camera to track hand, feet and head positions of up to two persons.
-Color Tracking: Track objects by color.
-Motion Sensors: Uses the combination of Accelerometer, Gyroscope and Magnetometer to detect the current rotation of the device.
-Accelerometer: Measures the acceleration of the device.
-Apple Watch: Use the motion sensors, heart rate, touch and digital crown.
-Game Controller: Use buttons, thumbsticks and everything else.
-Microphone: Detects pitch and volume using the microphone.
-External Input Device: Receives MIDI events of connected input devices.

Output Modules:
-External Output Device: Send MIDI events to any device accessible via Core MIDI.
-AudioUnit: Load any Music Device or MIDI Processor Audio Unit and generate sounds directly in the app.
-Core MIDI Network: Send MIDI via WiFi.
-Snarp Network MIDI: My own implementation to send MIDI via WiFi.
-SimpleSynth: Generate simple synthesizer sounds directly on the device.

Effects:
-Chord Splitter: Splits incoming chords into separate notes and sends these to separate channels.
-Channel Switcher: Change the MIDI channel of events.
-Value to MIDI Converter: Converter to convert numerical values (green ports) to MIDI events (orange ports).
-Transposer: Transpose MIDI notes.
-Arpeggiator: Cycles through the notes of incoming chords in a specific pattern.
-Speed: Computes a new value based on the change speed of another value.
-Beat: Play a beat if a value is changed quickly.
-Threshold: Plays notes if a value goes over a specific threshold.
-LFO: Generates an LFO from incoming values.
-Envelope: Generates an ADSR output value based on note input.
-Latch: Keeps notes alive until the same note is played again.
-Filter: Filter events by channel, note, velocity or CC.

HealthKit is used in the app to access Apple Watch data like heart beat or motion sensors. The app only uses sensor data to generate MIDI events.