SaeA-ICT
← Works
EDU · 2024

Sound Pen (Sonix OID)

OID recognition accuracy 99.4%, 10,000 units shipped in first run.

SaeA-ICT developed an educational sound pen that recognizes OID codes printed on learning materials and plays audio, translation content, and interactive learning games.

This project was not designed to replace printed books with screens. It was designed to keep the printed book experience and add audio responses and learning functions where they are needed.

When a user touches a specific area of a book, the OID recognition module inside the pen reads the code, and the backend MCU executes the linked audio content and learning logic.

▲ An educational sound pen that connects printed learning materials with audio content through OID code recognition

Technology Stack

The product uses optical code recognition technology based on OID 3.0 from SONiX Technology. For OID recognition, the SONiX SNM9S500C3000A OID Decoder SoC Module was applied. This module integrates a CMOS sensor and an OID image decoder as an input device.

The module supports OID2, OID3 General Code, and OID3 Position Code. It communicates with the backend MCU through a 2-wire SCK / SDIO interface.

The main controller uses the AK1060L Mobile Multimedia Application Processor from ANYKA. The AK1060L provides an ARM926EJ-based architecture, audio codec, NAND Flash interface, USB 2.0, SPI, UART, MMC/SD, ADC, DAC, and headphone output functions.

The product also includes an nRF module for Bluetooth communication. In addition, curriculum-based answer-guiding game logic and an OID3 Position Code-based writing function were implemented.

  • SONiX OID 3.0 optical code recognition technology
  • SONiX SNM9S500C3000A OID Decoder SoC Module
  • OID2, OID3 General Code, and OID3 Position Code recognition
  • OID3 Position Code-based writing function
  • 2-wire SCK / SDIO communication with the OID module
  • ANYKA AK1060L Mobile Multimedia Application Processor
  • ARM926EJ-based multimedia processing architecture
  • NAND Flash-based audio and data storage structure
  • Audio playback structure for MP3, WMA, APE, WAV, FLAC, and related formats
  • nRF module-based Bluetooth communication
  • Curriculum-based answer-guiding game algorithm for early learning content
  • Sequential, random, time-limited, and correct-or-wrong response game modes
  • IR LED calibration for stable optical recognition

Development Method

The core goal of this project was “to accurately recognize where the user touched on a printed book and execute the right response for that location.”

To achieve this, the internal structure of the sound pen was divided into OID recognition, main control, audio playback, communication, and educational game logic.

The SONiX OID module reads the dot pattern printed on the book and sends the recognized OID index to the AK1060L-based main controller through the 2-wire interface.

The main controller then executes actions such as audio playback, translation playback, answer checking, wrong-answer guidance, and movement to the next question based on the received code value.

The AK1060L served as the multimedia processing core of the sound pen. Firmware was configured to handle audio playback, NAND Flash data access, button input, audio output, power-related control, and peripheral interfaces.

OID3 Position Code was used for the writing function. This allowed the device to process position-based input, not only simple code recognition.

To improve optical recognition stability, IR LED calibration was included in the development process according to the SONiX-recommended procedure.

 

▲ OID recognition, multimedia processing, and Bluetooth communication integrated into a compact pen-type device

Key Deliverables

  • Educational sound pen device based on OID code recognition
  • Audio playback mapped to specific areas of printed learning materials
  • One-time and continuous translation playback functions
  • OID3 Position Code-based writing function
  • Six types of interactive game formats
  • Sequential game mode
  • Random game mode
  • Time-limited game mode
  • Correct and incorrect answer response logic
  • AK1060L-based audio playback firmware
  • nRF Bluetooth communication structure
  • SONiX OID module interface circuit and communication handling
  • Recognition stabilization based on IR LED calibration

The sound pen is not simply an audio playback device. It is an educational device designed to trigger different learning flows depending on the touched area of the printed material and the structure of the early learning curriculum.

For example, when a user selects a specific picture or word, the sound pen recognizes the OID code at that location and checks whether the answer is correct. It then provides voice feedback such as correct-answer guidance, wrong-answer guidance, retry instructions, or movement to the next question.

 

▲ Answer-guiding interactive learning structure designed for early childhood education content

Technical Verification Points

  • OID code recognition distance and angle verification
  • Recognition stability according to print quality of learning materials
  • IR LED calibration procedure
  • 2-wire communication timing verification
  • Code value and audio data mapping verification
  • Correct and incorrect answer game logic verification
  • Button, battery, audio output, and Bluetooth communication testing
  • Circuit and firmware structure prepared for production transfer

Practical Outcome

Traditional printed learning materials depend on reading and external guidance from teachers or parents. With the sound pen, the printed material itself can provide audio guidance, translation, and question-and-answer interaction.

Publishers can keep their existing printed books while adding audio content and game-based learning flows. Users can enjoy a more vivid learning experience with a simple touch action.

Through this project, SaeA-ICT secured practical experience in OID-based educational device development, including hardware design, firmware development, audio data mapping, communication processing, game algorithm implementation, and production transfer.

 

Keep the printed book.
Add sound and interaction where it matters.

Do you have a product idea?

From device design and firmware to content integration and production transfer — SaeA-ICT builds it with you.