Issue in streaming video in AWS Kinesis through G-Streamer #1876

ambroseeverhart · 2023-12-07T14:34:33Z

ambroseeverhart
Dec 7, 2023

hello smart minds,

I'm diving into the world of streaming with GStreamer on a Raspberry Pi to AWS Kinesis, and I've hit a roadblock.
i shared the command i executed followed by logs from my terminal and aws test page.
./kvsWebrtcClientMasterGstSample <channel_name> video-only rtspsrc rtsp://:@xx.xx.xx.xx/live1.sdp
2023-12-07 13:59:29.215 PROFILE createRtcCertificate(): [Certificate creation time] Time taken: 87 ms
2023-12-07 13:59:30.202 PROFILE createRtcCertificate(): [Certificate creation time] Time taken: 73 ms
2023-12-07 13:59:31.205 PROFILE createRtcCertificate(): [Certificate creation time] Time taken: 76 ms
[2023/12/07 13:59:52:6706] N: LWS: 4.2.1-v4.2.2, loglevel 7
[2023/12/07 13:59:52:6711] N: NET CLI H1 H2 WS ConMon IPv6-absent
[2023/12/07 13:59:52:6723] N: ++ [wsi|0|pipe] (1)
[2023/12/07 13:59:52:6732] N: ++ [vh|0|netlink] (1)
[2023/12/07 13:59:52:6739] N: ++ [vh|1|default||-1] (2)
2023-12-07 13:59:52.687 PROFILE executeGetTokenSignalingState(): [Get token call] Time taken: 0 ms
2023-12-07 13:59:52.687 PROFILE createSignalingClientSync(): [Create signaling client] Time taken: 19 ms
2023-12-07 13:59:52.688 PROFILE executeDescribeSignalingState(): [Describe signaling call] Time taken: 0 ms
2023-12-07 13:59:52.689 PROFILE executeGetEndpointSignalingState(): [Get endpoint signaling call] Time taken: 0 ms
[2023/12/07 13:59:52:6918] N: ++ [wsicli|0|POST/h1/r-93960ca9.kinesisvideo.us-west-2.amazonaws.] (1)
[2023/12/07 13:59:53:8446] N: -- [wsicli|0|POST/h1/r-93960ca9.kinesisvideo.us-west-2.amazonaws.] (0) 1.152s
2023-12-07 13:59:53.845 PROFILE executeGetIceConfigSignalingState(): [Get ICE config signaling call] Time taken: 1155 ms
2023-12-07 13:59:53.845 PROFILE signalingClientFetchSync(): [Fetch signaling client] Time taken: 1157 ms
[2023/12/07 13:59:53:8492] N: ++ [wsicli|1|WS/h1/m-11e07cd0.kinesisvideo.us-west-2.amazonaws.co] (1)
2023-12-07 13:59:54.724 PROFILE executeConnectSignalingState(): [Connect signaling call] Time taken: 878 ms
2023-12-07 13:59:54.724 PROFILE signalingClientConnectSync(): [Connect signaling client] Time taken: 878 ms
2023-12-07 13:59:54.725 PROFILE initSignaling(): [Signaling Get token] 0 ms
2023-12-07 13:59:54.725 PROFILE initSignaling(): [Signaling Describe] 0 ms
2023-12-07 13:59:54.725 PROFILE initSignaling(): [Signaling Describe Media] 0 ms
2023-12-07 13:59:54.726 PROFILE initSignaling(): [Signaling Create Channel] 0 ms
2023-12-07 13:59:54.726 PROFILE initSignaling(): [Signaling Get endpoint] 0 ms
2023-12-07 13:59:54.726 PROFILE initSignaling(): [Signaling Get ICE config] 1155 ms
2023-12-07 13:59:54.727 PROFILE initSignaling(): [Signaling Connect] 878 ms
2023-12-07 13:59:54.727 PROFILE initSignaling(): [Signaling create client] 19 ms
2023-12-07 13:59:54.727 PROFILE initSignaling(): [Signaling fetch client] 1157 ms
2023-12-07 13:59:54.728 PROFILE initSignaling(): [Signaling connect client] 878 ms
2023-12-07 13:59:59.665 PROFILE getIpWithHostName(): ICE Server address for stun..................amazonaws.com with getaddrinfo: xx.xx.xx.xx
2023-12-07 13:59:59.666 PROFILE createIceAgent(): [ICE server parsing] Time taken: 51 ms
2023-12-07 13:59:59.666 PROFILE getIpWithHostName(): ICE Server address for ................: xx.xx.xx.xx
2023-12-07 13:59:59.667 PROFILE createIceAgent(): [ICE server parsing] Time taken: 0 ms
2023-12-07 13:59:59.667 PROFILE getIpWithHostName(): ICE Server address for .........kinesisvideo.......amazonaws.com: xx.xx.xx.xx
2023-12-07 13:59:59.668 PROFILE createIceAgent(): [ICE server parsing] Time taken: 0 ms
2023-12-07 13:59:59.668 PROFILE getIpWithHostName(): ICE Server address for ........kinesisvideo.......amazonaws.com: xx.xx.xx.xx
2023-12-07 13:59:59.669 PROFILE createIceAgent(): [ICE server parsing] Time taken: 0 ms
2023-12-07 13:59:59.669 PROFILE createPeerConnection(): [Peer connection object creation time] Time taken: 60 ms
2023-12-07 13:59:59.683 PROFILE iceAgentStartGathering(): [Host candidate gathering from local interfaces] Time taken: 0 ms
2023-12-07 13:59:59.683 PROFILE iceAgentStartGathering(): [Host candidates setup time] Time taken: 0 ms
2023-12-07 13:59:59.684 PROFILE iceAgentStartGathering(): [Srflx candidates setup time] Time taken: 0 ms
2023-12-07 13:59:59.687 PROFILE iceAgentStartGathering(): [Relay candidates setup time] Time taken: 2 ms
2023-12-07 13:59:59.702 PROFILE signalingSendMessageSync(): [Offer Received to Answer Sent time] Time taken: 93 ms
2023-12-07 13:59:59.702 PROFILE sendSignalingMessage(): [Signaling offer received to answer sent time] 93 ms
2023-12-07 13:59:59.740 WARN socketConnectionIsConnected(): socket connection check failed with errno Operation already in progress(114)
2023-12-07 13:59:59.790 WARN socketConnectionIsConnected(): socket connection check failed with errno Operation already in progress(114)
2023-12-07 13:59:59.840 WARN socketConnectionIsConnected(): socket connection check failed with errno Operation already in progress(114)
2023-12-07 13:59:59.890 WARN socketConnectionIsConnected(): socket connection check failed with errno Operation already in progress(114)
2023-12-07 14:00:00.032 PROFILE iceAgentReadyStateSetup(): Selected pair RIzKGkTg4_TwP1GPV2y, local candidate type: host. remote candidate type: host. Round trip time 3 ms. Local candidate priority: 0, ice candidate pair priority: 27502361354174463
2023-12-07 14:00:00.033 PROFILE executeReadyIceAgentState(): [Time taken to get ICE Agent ready for media exchange] Time taken: 351 ms
2023-12-07 14:00:00.047 PROFILE iceAgentGatherCandidateTimerCallback(): [Candidate gathering time] Time taken: 364 ms
2023-12-07 14:00:00.221 PROFILE createRtcCertificate(): [Certificate creation time] Time taken: 89 ms
2023-12-07 14:00:00.967 PROFILE dtlsSessionChangeState(): [DTLS initialization completion] Time taken: 1183 ms
2023-12-07 14:00:00.969 PROFILE changePeerConnectionState(): [ICE Hole Punching Time] Time taken: 1287 ms

[2023-12-07T13:59:35.312Z] [INFO] Page load...
[2023-12-07T13:59:35.312Z] [INFO] Page loaded
[2023-12-07T13:59:36.410Z] [INFO] [FETCH-REGIONS] Successfully fetched regions!
[2023-12-07T13:59:55.841Z] [INFO] [FORM_VALUES] Running the sample with the following options: {
"region": "######",
"channelName": "#####",
"clientId": "#####",
"sendVideo": true,
"sendAudio": false,
"streamName": "",
"ingestMedia": false,
"showJSSButton": false,
"openDataChannel": false,
"widescreen": true,
"fullscreen": false,
"useTrickleICE": true,
"natTraversalDisabled": false,
"forceSTUN": false,
"forceTURN": false,
"accessKeyId": "********************",
"endpoint": null,
"secretAccessKey": "****************************",
"enableDQPmetrics": true,
"sendHostCandidates": true,
"acceptHostCandidates": true,
"sendRelayCandidates": true,
"acceptRelayCandidates": true,
"sendSrflxCandidates": true,
"acceptSrflxCandidates": true,
"sendPrflxCandidates": true,
"acceptPrflxCandidates": true,
"sendTcpCandidates": true,
"acceptTcpCandidates": true,
"sendUdpCandidates": true,
"acceptUdpCandidates": true
}
[2023-12-07T13:59:55.843Z] [INFO] [VIEWER] Client id is:.............
[2023-12-07T13:59:55.844Z] [INFO] [WebRTC] DQP METRICS TEST STARTED: "......................"
[2023-12-07T13:59:56.698Z] [INFO] [VIEWER] Channel ARN: arn:aws:kinesisvideo:.................:channel/####/
[2023-12-07T13:59:56.700Z] [INFO] [VIEWER] Not using media ingestion feature
[2023-12-07T13:59:56.960Z] [INFO] [VIEWER] Endpoints: {
"HTTPS": "https://..................amazonaws.com",
"WSS": "wss://....................amazonaws.com"
}
[2023-12-07T13:59:57.535Z] [INFO] [VIEWER] ICE servers: [
{
"urls": "s###############"
},
{
"urls": [
"turn:..................kinesisvideo.####=udp",
"turns:..........................kinesisvideo.###=udp",
"turns:...................kinesisvideo.######=tcp"
],
"username": "#####",
"credential": "####="
},
{
"urls": [
"turn:..................kinesisvideo.####=udp",
"turns:..........................kinesisvideo.###=udp",
"turns:...................kinesisvideo.######=tcp"
],
"username": "#####",
"credential": "####="
}
]
[2023-12-07T13:59:57.539Z] [INFO] [VIEWER] Starting viewer connection
[2023-12-07T13:59:58.472Z] [INFO] [VIEWER] Connected to signaling service
[2023-12-07T13:59:59.261Z] [INFO] [VIEWER] Creating SDP offer
[2023-12-07T13:59:59.283Z] [INFO] [VIEWER] Sending SDP offer
[2023-12-07T13:59:59.285Z] [INFO] [VIEWER] Generating ICE candidates
[2023-12-07T13:59:59.295Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.296Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.298Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.298Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.401Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.403Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.404Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.406Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.588Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.590Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.592Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.593Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.836Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.838Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.849Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.850Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.938Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.940Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.942Z] [INFO] [VIEWER] Generated ICE candidate
[2023-12-07T13:59:59.944Z] [INFO] [VIEWER] Sending ICE candidate
[2023-12-07T13:59:59.987Z] [INFO] [VIEWER] Received SDP answer
[2023-12-07T13:59:59.990Z] [INFO] [VIEWER] Received ICE candidate
[2023-12-07T14:00:00.001Z] [INFO] [VIEWER] Received remote track
[2023-12-07T14:00:00.002Z] [INFO] [VIEWER] Received remote track
[2023-12-07T14:00:00.009Z] [INFO] [VIEWER] All ICE candidates have been generated
[2023-12-07T14:00:00.224Z] [INFO] [VIEWER] Received ICE candidate
[2023-12-07T14:00:00.540Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:00.959Z] [INFO] [VIEWER] Connection to peer successful!
[2023-12-07T14:00:01.540Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:02.543Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:03.543Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:04.544Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:05.543Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:06.997Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:07.997Z] [INFO] [DQP TEST] Waiting for stream stats...
[2023-12-07T14:00:08.997Z] [INFO] [DQP TEST] Waiting for stream stats...

i gave correct access key ,secret key ,all dependencies, credentials and certificate path but the issue is persistent

Has anyone else faced this issue? If so, could you share some insights on how to tackle it? I'm eager to get past this hurdle and continue with my streaming project.

sirknightj · 2023-12-07T15:27:55Z

sirknightj
Dec 7, 2023
Maintainer

Hi @ambroseeverhart, what's the issue you are running into, can you provide more details? Is it that the two won't connect to each other?

If so, it looks like the C sample is using us-west-2 region. Not sure if that's the same what you're using in the Javascript. If you need to change the C region use export AWS_DEFAULT_REGION=your-region before running.

0 replies

ambroseeverhart · 2023-12-08T09:47:58Z

ambroseeverhart
Dec 8, 2023
Author

Hi @sirknightj

the major issue is it i cannot connect with gstreamer
i am sending one of the pipelines i tried to connect gstreamer and we dont need audio (video-only is the requirement)

**GST_DEBUG=3 gst-launch-1.0 rtspsrc location=rtsp://username:[email protected]/

live1.sdp ! rtph264depay ! h264parse ! queue ! matroskamux ! appsink**
0:00:15.550524566 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0x120000: 'AVR (Audio Visual Research)' is not mapped
0:00:15.551764524 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0x180000: 'CAF (Apple Core Audio File)' is not mapped
0:00:15.552516332 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0x100000: 'HTK (HMM Tool Kit)' is not mapped
0:00:15.553259766 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0xc0000: 'MAT4 (GNU Octave 2.0 / Matlab 4.2)' is not mapped
0:00:15.553963549 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0xd0000: 'MAT5 (GNU Octave 2.1 / Matlab 5.0)' is not mapped
0:00:15.554694966 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0x210000: 'MPC (Akai MPC 2k)' is not mapped
0:00:15.555438757 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0xe0000: 'PVF (Portable Voice Format)' is not mapped
0:00:15.556194582 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0x160000: 'SD2 (Sound Designer II)' is not mapped
0:00:15.557051691 137 0x4c6840 WARN default gstsf.c:98:gst_sf_create_audio_template_caps: format 0x190000: 'WVE (Psion Series 3)' is not mapped
0:00:23.283955194 136 0x15e580 WARN GST_REGISTRY gstregistry.c:1845:gst_update_registry: registry update failed: Error writing registry cache to /.cache/gstreamer-1.0/registry.arm.bin: No such file or directory
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:[email protected]/live1.sdp
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Progress: (request) Sending PLAY request
0:00:23.767889422 136 0x1c7a00 FIXME default gstutils.c:3826:gst_pad_create_stream_id_internal:fakesrc0:src Creating random stream-id, consider implementing a deterministic way of creating a stream-id
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
0:00:23.855576489 136 0x197db0 WARN matroskamux matroska-mux.c:2744:gst_matroska_mux_start: downstream is not seekable, but streamable=false. Will ignore that and create streamable output instead
0:00:23.856792022 136 0x197db0 FIXME basesink gstbasesink.c:3077:gst_base_sink_default_event: stream-start event without group-id. Consider implementing group-id handling in the upstream elements
0:00:53.574797197 136 0x1c7a30 WARN rtspsrc gstrtspsrc.c:2693:on_timeout: source 01262316, stream 01262316 in session 0 timed out
0:01:25.749732426 136 0x198c30 WARN rtspsrc gstrtspsrc.c:4767:gst_rtspsrc_loop_udp: warning: Unhandled return value -7.
WARNING: from element /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0: Could not read from resource.
Additional debug info:
gstrtspsrc.c(4767): gst_rtspsrc_loop_udp (): /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0:
Unhandled return value -7.
0:01:25.753517034 136 0x198c30 WARN rtspsrc gstrtspsrc.c:4838:gst_rtspsrc_loop_udp: error: Could not receive message. (System error)
ERROR: from element /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0: Could not read from resource.
Additional debug info:
gstrtspsrc.c(4838): gst_rtspsrc_loop_udp (): /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0:
Could not receive message. (System error)
Execution ended after 0:01:01.997036712
Setting pipeline to PAUSED ...
0:01:25.757687667 136 0x198c30 WARN rtspsrc gstrtspsrc.c:5124:gst_rtspsrc_loop: error: Internal data stream error.
0:01:25.758694767 136 0x198c30 WARN rtspsrc gstrtspsrc.c:5124:gst_rtspsrc_loop: error: streaming stopped, reason error (-5)

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Issue in streaming video in AWS Kinesis through G-Streamer #1876

{{title}}

Replies: 2 comments

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Issue in streaming video in AWS Kinesis through G-Streamer #1876

ambroseeverhart Dec 7, 2023

Replies: 2 comments

sirknightj Dec 7, 2023 Maintainer

ambroseeverhart Dec 8, 2023 Author

**GST_DEBUG=3 gst-launch-1.0 rtspsrc location=rtsp://username:[email protected]/

ambroseeverhart
Dec 7, 2023

sirknightj
Dec 7, 2023
Maintainer

ambroseeverhart
Dec 8, 2023
Author