You are here

FX3 GPIF Config for Audio+Video application | Cypress Semiconductor

FX3 GPIF Config for Audio+Video application

Summary: 5 Replies, Latest post by harshad_1712281 on 01 Dec 2016 10:35 AM PST
Verified Answers: 0
Last post
Log in to post new comments.
harshad_1712281's picture
User
10 posts

Hi,

I am using an A/V source connected to a decoder chip which splits them both. The video output enters FPGA and is buffered as needed for the FX3 GPIF to process it for UVC. This part all works fine. 

However, now I need to also handle the audio and make it a part of the input stream to GPIF. But, I'm confused how to insert audio in the middle of the video stream on the D0 to D31 bit lines (FX3 GPIF input pins) without damaging the video stream and ensuring that the Windows USB Driver on PC (USB Host) is able to read it and play it successfully.

Any insight in this matter would be helpful.

Thanks,

Harshad.

Jeff Katz's picture
User
1 post

Hi All,

I have a similar question, so I will jump on this thread. I am making a device which will capture audio and video at high quality and stream them to the PC with as little latency as possible. For video, the way is clear (with many examples, including UVC). 

However, for Audio, and simultaneous Audio/Video, it is very unclear to me. I can choose from various video standards, however the audio source Audio is I2S. I see that the FX3's I2S interface only supports transmission. I am willing to reduce the quality of my Video data to 24 bits, so there should be enough pins. Any help or examples would be wonderful. 

 

Thanks,

Jeff

harshad_1712281's picture
User
10 posts

Hi Jeff,

Good to know others are suffering with the same issue.

Yes, I2S receiver needs to be made separately in some other chip. Try an FPGA for that.

I would suggest sending audio frames after every video frame or at a specific interval to maintain video quality at 32 pins equivalent.

Also if the frames are neatly separated, the video can be sent using UVC while the audio can be sent using UAC.

Let me know what you think about it. 

thanks,

Harshad.

 

lis_user1's picture
User
32 posts

How about custom protocol with 24-bit video and [31:24] to carry audio? Or insert an audio sample every few lines of video? 

harshad_1712281's picture
User
10 posts

Hi,

Currently I'm trying to insert an audio frame after every few video lines. Hope that works for me.

Thanks,

Harshad

harshad_1712281's picture
User
10 posts

Hi,

To solve my issue of streaming both audio and video, would it help if I basically mixed the examples of UAC and UVC with the appropriate GPIF II state Machine?

Thanks,

Harshad

Log in to post new comments.