Crazyflie AI-deck V1.1 – with GAP8 RISC-V MCU & ESP32 Wi-Fi

SKU: SS114992445 Brand: Seeed Studio

Crazyflie AI-deck 1.1 is built around the GAP8 RISC-V multi-core MCU for the edge purpose of artificial intelligence.In addition, there is a ULP grayscale camera and an ESP32 WiFi MCU.All of these have created a pretty good platform for the development of low-power artificial intelligence for drones.

$424.95 AUD, inc GST

$386.32 AUD, exc GST

Available with a lead time
Expect dispatch between May 06 and May 08

Quantity Discounts:

3+ $370.86 (exc GST)
5+ $359.27 (exc GST)

Features

Ultra-low-power GAP8 8+1 core RISC-V processor, 512 Mbit HyperFlash and 64 Mbit HyperRAM for faster speeds
ESP32-based NINA-W102 Wi-Fi module to stream images to PC
Delivers over 10 GOPS of computing power at exceptionally low power consumption
Capture, analyze, and classify its environment with ULP camera
Perfect for micro-sized area research with Crazyflie 2.X UAV.
Perfect for complex artificial intelligence-based workloads like Convolutional Neural Networks to run onboard and path-finding projects

Note: This product is in early access stage. It means that while the hardware is working and tested, the software is still pretty much work in progress. For more information see the early access description page.

What is Crazyflie?

Crazyflie is a versatile open-source flying development platform that only weighs 27g and fits in the palm of your hand. Crazyflie is equipped with low-latency/long-range radio as well as Bluetooth LE. This gives you the option of downloading an app and using your mobile device as a controller or, in combination with the Crazyradio PA, using your computer to display data and fly with a game controller.

Description of Crazyflie AI-deck 1.1

Crazyflie AI-deck 1.1 enables low power on-board artificial intelligence capabilities for the Crazyflie using a GAP8 chip with RISC-V multi-core architecture, 512 Mbit HyperFlash and 64 Mbit HyperRAM. This lightweight and low-power combination opens up many research and development areas for the micro-sized Crazyflie 2.X UAV.

In addition, the AI-deck 1.1 has a Himax HM01B0 Bayer RGB camera with a NINA W102 Wi-Fi module to stream your images to a desktop as well as handling control.. These features fit the prerequisites of a convolutional neural network, but the AI-deck is not limited to the application of CNN's.

Note: To program this board, a compatible JTAG programmer/debugger is needed. Check here.

Workflow using GAPFlow

To design a neural network and deploy it on the AI-deck 1.1, you should know the workflow of the GAP8 SDK for AI applications that is provided by GreenWaves Technologies. A neural network can be designed, trained, and evaluated using Tensorflow and Keras in Python. To let this code be able to run on the AI deck 1.1, an automated process is executed by the GAPFlow of the GAP8 SDK.

What you should provide in this workflow is:

dataset with labels
neural network model
GAP application code
optional: own autotiler operator

Check out the GAPflow Model Extern explanation in the ai-example folder

Tensorflow and Keras use

Keras is a framework within Tensorflow. In addition to providing a neural network framework, it also provides examples of common and simple neural networks and provides datasets along with it. Though when you want to make an application you might want to use other datasets that are relevant for your application. For this, you have to supply your own dataset with labels, augmentation and transformations when required.

https://keras.io/datasets/

NNTool use

The NNTool makes use of post-training quantization and adjusts the quantized weights using a selection of images used for training the neural network.

https://github.com/GreenWaves-Technologies/gap_sdk/tree/master/tools/nntool

Block Diagram

Specifications

Power supply 3V-5V @ VCOM up to 300mA
1-wire memory for automatic expansion board detection
UART connected between GAP8 and Crazyflie (RX1, TX1)
UART connected between ESP32 (RX2, TX2)
ESP32 sysboot pin connected to Crazyflie (IO_1)
Reset to GAP8 and ESP32 connected to Crazyflie (IO_4)
SPI between GAP8 and ESP32
GAP8 (B1) -> ESP32 (GPIO_5) IO
ESP32 (GPIO_25) -> GAP8 (A13) IO
2 x Cortex-M 10-pin JTAG Interface to program on the GAP8 and ESP32
Can be easily mounted on the Crazyflie V2.1 with the 2 x 10-pin male headers
Button connected to ESP32 for UART bootloader or other actions
Green LED status indicators for GAP8 and ESP32

Mechanical drawing

Technical Details

Dimensions: 30mm x52mm x8mm
Weight: G.W 4.4g
Battery: Exclude

Part List

AI-deck 1.1 x1
Long pin headers x2

Documentations

Product Comments

Start the conversation

Exact shipping can be calculated on the view cart page (no login required).

Products that weigh more than 0.5 KG may cost more than what's shown (for example, test equipment, machines, >500mL liquids, etc).

We deliver Australia-wide with these options (depends on the final destination - you can get a quote on the view cart page):

$3+ for Stamped Mail (typically 10+ business days, not tracked, only available on selected small items)
$7+ for Standard Post (typically 6+ business days, tracked)
$11+ for Express Post (typically 2+ business days, tracked)
Pickup - Free! Only available to customers who live in the Newcastle region (must order online and only pickup after we email to notify you the order is ready). Orders placed after 2PM may not be ready until the following business day.

Non-metro addresses in WA, NT, SA & TAS can take 2+ days in addition to the above information.

Some batteries (such as LiPo) can't be shipped by Air. During checkout, Express Post and International Methods will not be an option if you have that type of battery in your shopping cart.

International Orders - the following rates are for New Zealand and will vary for other countries:

$12+ for Pack and Track (3+ days, tracked)
$16+ for Express International (2-5 days, tracked)

If you order lots of gear, the postage amount will increase based on the weight of your order.

Our physical address (here's a PDF which includes other key business details):

Unit 18, 132 Garden Grove Parade
Adamstown
NSW, 2289
Australia

Take a look at our customer service page if you have other questions such as "do we do purchase orders" (yes!) or "are prices GST inclusive" (yes they are!). We're here to help - get in touch with us to talk shop.

Have a product question? We're here to help!