streaming pixel interface -凯发k8网页登录

what is a streaming pixel interface?

in hardware, processing an entire frame of video at one time has a high cost in memory and area. to save resources, serial processing is preferable in hdl designs. vision hdl toolbox™ blocks and system objects operate on a pixel, line, or neighborhood rather than a frame. the blocks and objects accept and generate video data as a serial stream of pixel data and control signals. the control signals indicate the relative location of each pixel within the image or video frame. the protocol mimics the timing of a video system, including inactive intervals between frames. each block or object operates without full knowledge of the image format, and can tolerate imperfect timing of lines and frames.

all vision hdl toolbox blocks and system objects support single pixel streaming (with 1 pixel per cycle). some blocks and system objects also support multipixel streaming (with 2, 4, or 8 pixels per cycle) for high-rate or high-resolution video. multipixel streaming increases hardware resources to support higher video resolutions with the same hardware clock rate as a smaller resolution video. hdl code generation for multipixel streaming is not supported with system objects. use the equivalent blocks to generate hdl code for multipixel algorithms.

how does a streaming pixel interface work?

video capture systems scan video signals from left to right and from top to bottom. as these systems scan, they generate inactive intervals between lines and frames of active video.

the horizontal blanking interval is made up of the inactive cycles between the end of one line and the beginning of the next line. this interval is often split into two parts: the front porch and the back porch. these terms come from the synchronize pulse between lines in analog video waveforms. the front porch is the number of samples between the end of the active line and the synchronize pulse. the back porch is the number of samples between the synchronize pulse and the start of the active line.

the vertical blanking interval is made up of the inactive cycles between the ending active line of one frame and the starting active line of the next frame.

the scanning pattern requires start and end signals for both horizontal and vertical directions. the vision hdl toolbox streaming pixel protocol includes the blanking intervals, and allows you to configure the size of the active and inactive frame.

in the frame diagram, the blue shaded area to the left and right of the active frame indicates the horizontal blanking interval. the orange shaded area above and below the active frame indicates the vertical blanking interval. for more information on blanking intervals, see .

why use a streaming pixel interface?

pixel stream conversion using blocks and system objects

in simulink^®, use the block to convert framed video data to a stream of pixels and control signals that conform to this protocol. the control signals are grouped in a nonvirtual bus data type called pixelcontrol. you can configure the block to return a pixel stream with 1, 2, 4, or 8 pixels per cycle.

in matlab^®, use the object to convert framed video data to a stream of pixels and control signals that conform to this protocol. the control signals are grouped in a structure data type. you can configure the object to create a pixel stream with 1, 2, 4, or 8 pixels per cycle.

if your input video is already in a serial format, you can design your own logic to generate pixelcontrol control signals from your existing serial control scheme. for example, see and integrate vision hdl blocks into camera link system.

sample time

because the frame to pixels block creates a serial stream of the pixels of each input frame, the sample time of your video source must match the total number of pixels in the frame. the total number of pixels is total pixels per line × total video lines, so set the sample time to this value.

if your frame size is large, you may reach the fixed-step solver step size limit for sample times in simulink, and receive an error like this.

the computed fixed step size (1.0) is 1000000.0 times smaller than all
the discrete sample times in the model. 

timing diagram of single pixel serial interface

to illustrate the streaming pixel protocol, this example converts a frame to a sequence of control and data signals. consider a 2-by-3 pixel image. to model the blanking intervals, configure the serialized image to include inactive pixels in these areas around the active image:

you can configure the dimensions of the active and inactive regions with the frame to pixels block or the visionhdl.frametopixels object.

in the figure, the active image area is in the dashed rectangle, and the inactive pixels surround it. the pixels are labeled with their grayscale values.

the block or object serializes the image from left to right, one line at a time. the timing diagram shows the control signals and pixel data that correspond to this image, which is the serial output of the frame to pixels block for this frame, configured for single-pixel streaming.

for an example using the frame to pixels block to serialize an image, see .

for an example using the frametopixels object to serialize an image, see .

timing diagram of multipixel serial interface

this example converts a frame to a multipixel stream with 4 pixels per cycle and corresponding control signals. consider a 64-pixel-wide frame with these inactive areas around the active image.

the frame to pixels block configured for multipixel streaming returns pixel vectors formed from the pixels of each line in the frame from left to right. this diagram shows the top-left corner of the frame. the gray pixels show the active area of the frame, and the zero-value pixels represent blanking pixels. the label on each active pixel represents the location of the pixel in the frame. the highlighted boxes show the sets of pixels streamed on one cycle. the pixels in the inactive region are also streamed four at a time. the gray box shows the four blanking pixels streamed the cycle before the start of the active frame. the blue box shows the four pixel values streamed on the first valid cycle of the frame, and the orange box shows the four pixel values streamed on the second valid cycle of the frame. the green box shows the first four pixels of the next active line.

this waveform shows the multipixel streaming data and control signals for the first line of the same frame, streamed with 4 pixels per cycle. the pixelcontrol signals that apply to each set of four pixel values are shown below the data signals. because the vector has only one valid signal, the pixels in the vector are either all valid or all invalid. the hstart and vstart signals apply to the pixel with the lowest index in the vector. the hend and vend signals apply to the pixel with the highest index in the vector.

prior to the time period shown, the initial vertical blanking pixels are streamed four at a time, with all control signals set to false. this waveform shows the pixel stream of the first line of the image. the gray, blue, and orange boxes correspond to the highlighted areas of the frame diagram. after the first line is complete, the stream has two cycles of horizontal blanking that contains 8 invalid pixels (front and back porch). then, the waveform shows the next line in the stream, starting with the green box.

for an example model that uses multipixel streaming, see filter multipixel video streams.