A robotic activity system, which includes a board and an autonomous robotic device, is described herein. The board may display a line and one or more color patterns. The robotic device may traverse the line using one or more integrated sensors. For example, sensor data may include light intensity data for visible light reflected or emitted by the board. The sensor data may be analyzed to 1) ensure the robotic device follows the line and/or 2) detect color sequences associated with color patterns shown on the board. Upon detection of a color sequence, the robotic device may attempt to match the color sequence with a known color pattern definition. The color pattern definition may be associated with a function to be performed by the robotic device. Using multiple sets of color patterns and associated functions allows the robotic device to move in a variable and potentially unpredictable fashion.