Reference: https://www.bluebill.net/timestamps.html
Table of Contents |
---|
Fixing GoPro Video Creation Time
Install Pre-Requisits
Install ffmpeg, coreutils and jq.Check Creation Time
Code Block |
---|
./correctTime.sh DIVE_2_1_GH010089.MP4
DIVE_2_1_GH010089.MP4
Video Create Time (Zulu): 2023-06-13T19:12:11.000000Z
Video Create Time (local): 2023-06-13T15:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T19:12:11
Video Create Time (to local):2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-13T23:12:11.000000Z
To update the metadata use --update
|
In the above output we see that the local time was recorded as Zulu time. The local time was 19:12:11.
Fix Creation Time
Code Block |
---|
./correctTime.sh DIVE_2_1_GH010089.MP4 --update |
Verify Creation Time
Code Block |
---|
./correctTime.sh DIVE_2_1_GH010089.corrected.MP4
DIVE_2_1_GH010089.corrected.MP4
Video Create Time (Zulu): 2023-06-13T23:12:11.000000Z
Video Create Time (local): 2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T23:12:11
Video Create Time (to local):2023-06-13T23:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-14T03:12:11.000000Z
To update the metadata use --update |
Add Timestamp to Video
Code Block |
---|
./timestamp.sh DIVE_2_1_GH010089.corrected.MP4 |
Changes to the timestamp.sh script:
Code Block |
---|
TODO... |
Get Video File Information
Code Block |
---|
ffprobe -loglevel 0 -print_format json -show_format -show_streams "${INPUT}" | jq -r .format.tags.creation_time |
brew install ffmpeg
brew install coreutils
brew install jq |
Joining the Videos While Preserving Metadata
First create a text file (e.g. filesToMerge.txt) with all the chaptered video files that you want to merge into a single video e.g.
Code Block |
---|
file GH010097.MP4
file GH020097.MP4
file GH030097.MP4
file GH040097.MP4 |
Next, check the streams in the video files.
Code Block | ||
---|---|---|
| ||
ffprobe -show_format GH010097.MP4 |
Code Block |
---|
Stream #0:0[0x1](eng): Video: h264 (High) (avc1 / 0x31637661), yuvj420p(pc, bt709, progressive), 2704x1520 [SAR 1:1 DAR 169:95], 60002 kb/s, 59.94 fps, 59.94 tbr, 60k tbn (default)
Metadata:
creation_time : 2023-08-09T17:39:29.000000Z
handler_name : GoPro AVC
vendor_id : [0][0][0][0]
encoder : GoPro AVC encoder
timecode : 17:38:25:34
Stream #0:1[0x2](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 189 kb/s (default)
Metadata:
creation_time : 2023-08-09T17:39:29.000000Z
handler_name : GoPro AAC
vendor_id : [0][0][0][0]
timecode |
Code Block |
{ "streams": [ { "index": 0, "codec_name": "aac", "codec_long_name": "AAC (Advanced Audio Coding)", "profile": "LC",17:38:25:34 Stream #0:2[0x3](eng): Data: none (tmcd / 0x64636D74) (default) "codec_type": "audio", Metadata: creation_time : "codec_time_base": "1/48000", 2023-08-09T17:39:29.000000Z handler_name : GoPro TCD timecode "codec_tag_string": "mp4a", : 17:38:25:34 Stream #0:3[0x4](eng): Data: bin_data "codec_tag": "0x6134706d", (gpmd / 0x646D7067), 49 kb/s (default) Metadata: "sample_fmt": "fltp", creation_time : 2023-08-09T17:39:29.000000Z handler_name "sample_rate": "48000", GoPro MET Stream #0:4[0x5](eng): Data: none (fdsc / "channels": 2,0x63736466), 13 kb/s (default) Metadata: creation_time "channel_layout": "stereo", : 2023-08-09T17:39:29.000000Z handler_name : GoPro SOS |
The above video has 4 streams. Lets try to join streams 0,1 and 3.
Code Block | ||
---|---|---|
| ||
ffmpeg -f concat -safe 0 -i filesToMerge.txt -c copy -map 0:0 -map 0:1 -map 0:3 -c:v libx264 -pix_fmt yuv420p video-merged.mp4 |
Revise Scripts
Using the scripts from https://www.bluebill.net/timestamps.html
Revise timestamp.sh and correctTime.sh to use 'gdate' instead of 'date'.
See below for revised scripts.
Fixing GoPro Video Creation Time
Check Creation Time
Code Block |
---|
./correctTime.sh DIVE_2_1_GH010089.MP4
DIVE_2_1_GH010089.MP4
Video Create Time (Zulu): 2023-06-13T19:12:11.000000Z
Video Create Time (local): 2023-06-13T15:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T19:12:11
Video Create Time (to local):2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-13T23:12:11.000000Z
To update the metadata use --update
|
In the above output we see that the local time was recorded as Zulu time. The local time was 19:12:11.
Fix Creation Time
Code Block |
---|
./correctTime.sh DIVE_2_1_GH010089.MP4 --update |
Verify Creation Time
Code Block |
---|
./correctTime.sh DIVE_2_1_GH010089.corrected.MP4
DIVE_2_1_GH010089.corrected.MP4
Video Create Time (Zulu): 2023-06-13T23:12:11.000000Z
Video Create Time (local): 2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T23:12:11
Video Create Time (to local):2023-06-13T23:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-14T03:12:11.000000Z
To update the metadata use --update |
Command to Update Creation Time:
Code Block |
---|
ffmpeg -I <MOVIE> -c copy -metadata creation_time=2023-06-13-23:12:11.000000Z <OUTPUT> |
Add Timestamp to Video
Code Block |
---|
./timestamp.sh DIVE_2_1_GH010089.corrected.MP4 |
Changes to the timestamp.sh script:
- Removed -vcodec libx265
- Changed location of timestamp to top right corner
Code Block |
---|
...
#ffmpeg -i "${INPUT}" -vf drawtext="fontsize=30:fontcolor=yellow:text='%{pts\:localtime\:${EPOCH}}':x=(w-text_w) - 10:y=(h-text_h) - 10" -vcodec libx265 -crf 28 "${OUTPUT}"
ffmpeg -i "${INPUT}" -vf drawtext="fontsize=30:fontcolor=white:text='%{pts\:localtime\:${EPOCH}}':x=(w-text_w) - 10:y=10" -crf 28 "${OUTPUT}"
... |
Get Video File Information
Code Block |
---|
ffprobe -loglevel 0 -print_format json -show_format -show_streams <VIDEO_FILE> |
Code Block |
---|
{ "streams": [ { "bits_per_sample": 0, "r_frame_rate": "0/0", "avg_frame_rate": "0/0", "time_base": "1/48000", "start_pts": 0, "start_time": "0.000000", "duration_ts": 35213578, "duration": "733.616208", "bit_rate": "119736", "max_bit_rate": "128000", "nb_frames": "34391", "disposition": { "default": 1, "dub": 0, "original": 0, "commentindex": 0, "lyrics"codec_name": 0"aac", "karaokecodec_long_name": 0, "AAC (Advanced Audio Coding)", "forcedprofile": 0"LC", "hearingcodec_impairedtype": 0"audio", "visual_impaired"codec_time_base": 0"1/48000", "cleancodec_tag_effectsstring": 0"mp4a", "attachedcodec_pictag": 0"0x6134706d", "timedsample_thumbnailsfmt": 0"fltp", }"sample_rate": "48000", "tagschannels": {2, "creationchannel_timelayout": "2023-07-16T15:22:49.000000Zstereo", "languagebits_per_sample": "eng"0, "handlerr_frame_namerate": "Core Media Audio"0/0", } "avg_frame_rate": "0/0", }, {"time_base": "1/48000", "indexstart_pts": 10, "codecstart_nametime": "h2640.000000", "codecduration_long_namets": "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", "profile35213578, "duration": "High733.616208", "codecbit_typerate": "video119736", "codecmax_timebit_baserate": "1001/120000128000", "codecnb_tag_stringframes": "avc134391", "codec_tagdisposition": "0x31637661",{ "widthdefault": 12801, "heightdub": 7200, "coded_width "original": 12800, "coded_height "comment": 7200, "has_b_frameslyrics": 0, "sample_aspect_ratio "karaoke": "1:1"0, "display_aspect_ratio "forced": "16:9"0, "pixhearing_fmtimpaired": "yuv420p"0, "levelvisual_impaired": 320, "colorclean_rangeeffects": "tv"0, "colorattached_spacepic": "bt709"0, "colortimed_transferthumbnails": "bt709",0 "color_primaries": "bt709"}, "chroma_locationtags": "left",{ "fieldcreation_ordertime": "progressive2023-07-16T15:22:49.000000Z", "refslanguage": 1"eng", "ishandler_avcname": "trueCore Media Audio", "nal_length_size": "4", } }, "r_frame_rate": "60000/1001", { "avg_frame_rateindex": "60000/1001"1, "timecodec_basename": "1/60000h264", "startcodec_ptslong_name": 0 "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10", "start_timeprofile": "0.000000High", "durationcodec_tstype": 44016973"video", "durationcodec_time_base": "733.6162171001/120000", "bitcodec_tag_ratestring": "8069838avc1", "bits_per_raw_samplecodec_tag": "80x31637661", "nb_frameswidth": "43973"1280, "dispositionheight": { 720, "defaultcoded_width": 11280, "dubcoded_height": 0720, "original"has_b_frames": 0, "commentsample_aspect_ratio": 0"1:1", "lyrics"display_aspect_ratio": 0"16:9", "pix_fmt": "karaokeyuv420p": 0, "forcedlevel": 032, "hearingcolor_impairedrange": 0"tv", "visualcolor_impairedspace": 0"bt709", "cleancolor_effectstransfer": 0"bt709", "attachedcolor_picprimaries": 0"bt709", "timedchroma_thumbnailslocation": 0"left", } "field_order": "progressive", "tagsrefs": {1, "creationis_timeavc": "2023-07-16T15:22:49.000000Ztrue", "language"nal_length_size": "und4", "handler_name"r_frame_rate": "Core Media Video"60000/1001", } "avg_frame_rate": "60000/1001", } ], "formattime_base": {"1/60000", "filename "start_pts": "Dive2.mp4"0, "nbstart_streamstime": 2"0.000000", "nbduration_programsts": 044016973, "format_name "duration": "mov,mp4,m4a,3gp,3g2,mj2733.616217", "formatbit_long_namerate": "QuickTime / MOV8069838", "start_time "bits_per_raw_sample": "0.0000008", "duration "nb_frames": "733.61621743973", "sizedisposition": "751679577",{ "bit_rate": "8196978", "default": 1, "probe_scoredub": 1000, "tagsoriginal": {0, "major_brand "comment": "mp42"0, "minor_version "lyrics": "1"0, "compatible_brandskaraoke": "isommp41mp42"0, "creation_time "forced": "2023-07-16T15:22:49.000000Z"0, } } } |
Scripts
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
#!/usr/bin/env bash # ----------- # SPDX-License-Identifier: MIT # Copyright (c) 2022 Troy Williams # uuid "hearing_impaired": 0, = 70204dea-f8b9-11ec-a408-cbfc46763958 # author"visual_impaired": 0, = Troy Williams # email = troy.williams@bluebill.net # date"clean_effects": 0, = 2022-06-30 # ----------- # this script will add timestamps (like security cameras) to the bottom left # corner of the video. It will use the creation date as the starting point of # the timestamp counter. The output video will be re-encoded to h265 format. # NOTE: Some videos indicate they are in UTC, but in fact are not.They will need # be correct otherwise the timestamp will be incorrect. # NOTE: If the creation_time isn't set, the video will be skipped. # Usage: # $ ./timestamp.sh 20210613_191928.mp4 # loop through files in a folder: # $ for FILE in ./2022-06-28/*; do ./timestamp.sh "${FILE}"; done # $ for FILE in ./2022-06-28/*; do ./timestamp.sh "${FILE}" --over-write; done # Requirements: # JSON parser: $ sudo apt install jq # References # https://www.cyberciti.biz/faq/unix-linux-bsd-appleosx-bash-assign-variable-command-output/ # https://stackoverflow.com/questions/1955505/parsing-json-with-unix-tools # https://www.baeldung.com/linux/use-command-line-arguments-in-bash-script # https://stackoverflow.com/a/965069 # https://www.howtogeek.com/529219/how-to-parse-json-files-on-the-linux-command-line-with-jq/ # https://cameronnokes.com/blog/working-with-json-in-bash-using-jq/ # https://stackoverflow.com/questions/965053/extract-filename-and-extension-in-bash # https://ourcodeworld.com/articles/read/1484/how-to-get-the-information-and-metadata-of-a-media-file-audio-or-video-in-json-format-with-ffprobe # ffprobe -loglevel 0 -print_format json -show_format -show_streams GX013438.MP4 # ---------------- # Set the script to halt on errors set -e if [[ -z "$1" ]]; then echo "USAGE: $ 1./timestamp.sh video.mp4" exit 1 fi # Get the movie name # MOVIE=${1} # What is the full path of the movie name? INPUT=$(readlink -f "$1") # Strip longest match of */ from start filename="${INPUT##*/}" # Substring from 0 thru pos of filename dir="${INPUT:0:${#INPUT} - ${#filename}}" # Strip shortest match of . plus at least one non-dot char from end base="${filename%.[^.]*}" # Substring from len of base thru end ext="${filename:${#base} + 1}" # If we have an extension and no base, it's really the base if [[ -z "$base" && -n "$ext" ]]; then base=".$ext" ext="" fi # Create the new file name OUTPUT="${dir}"/"${base}".stamped."${ext}" # ---------- # Debugging Code # echo "MOVIE = ${MOVIE}" # echo "INPUT = ${INPUT}" # echo "filename = ${filename}" # echo "dir = ${dir}" # echo "base = ${base}" # echo "ext = ${ext}" # echo "OUTPUT = ${OUTPUT}" # ---------- # need to use raw mode `-r` in jq call to return a raw string otherwise it will # be trouble to deal with STARTDATE=$(ffprobe -loglevel 0 -print_format json -show_format -show_streams "${INPUT}" | jq -r .format.tags.creation_time) if [[ -z "${STARTDATE}" ]]; then echo "ERROR - No creation_time in metadata! ${INPUT}" exit 1 fi # Convert the date to EPOCH. This will be used to set the time for the draw text # method. EPOCH=$(date --date="${STARTDATE}" +%s) echo "Video Create Time: ${STARTDATE} (${EPOCH})" # we assume that the STARTDATE is in UTC 0000, Zulu time, GMT and that we want # to convert it to the local time on the computer. ffmpeg -i "${INPUT}" -vf drawtext="fontsize=30:fontcolor=yellow:text='%{pts\:localtime\:${EPOCH}}':x=(w-text_w) - 10:y=(h-text_h) - 10" -vcodec libx265 -crf 28 "${OUTPUT}" if [ "${3:-"invalid"}" == "--over-write" ]; then echo "Moving ${OUTPUT} -> ${INPUT}" mv "${OUTPUT}" "${INPUT}" else echo "To overwrite the existing video, use --over-write" fi |
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
#!/usr/bin/env bash
# -----------
# SPDX-License-Identifier: MIT
# Copyright (c) 2022 Troy Williams
# uuid = e577e81c-f938-11ec-9c1a-0d95d112ee30
# author = Troy Williams
# email = troy.williams@bluebill.net
# date = 2022-07-01
# -----------
# This script will take the video and correct the creation time issue with it.
# It assumes that the the creation time did not have the proper timezone set.
# This means that other programs will attempt to convert from GMT/Zulu time and
# get the wrong time stamp.
# This script assumes that the video has the correct local time, but was
# inserted without a timezone. It will extract that time, and configure it as a
# local time. It will then convert the local time properly to UTC +00:00 and
# write it back to the video.
# Generally this script would be executed before the `timestamp.sh` script.
#NOTE: This script should only be run if the timestamps stored in the video are
#not correctly set to UTC time.
# Usage:
# List the creation time and what it would be in local time:
# $ ./correct_times.sh GX013443.MP4
# Write the corrected local time to the video.
# $ ./correct_times.sh GX013443.MP4 --update
# Write the corrected local time to the video.and overwrite the existing file
# $ ./correct_times.sh GX013443.MP4 --update --over-write
# loop through files in a folder:
# $ for FILE in ./2022-06-28/*; do ./correct_times.sh "${FILE}"; done
# $ for FILE in ./2022-06-28/*; do ./correct_times.sh "${FILE}" --update; done
# $ for FILE in ./2022-06-28/*; do ./correct_times.sh "${FILE}" --update --over-write; done
# Requirements:
# JSON parser: $ sudo apt install jq
# References
# https://stackoverflow.com/questions/16548528/command-to-get-time-in-milliseconds
# https://stackoverflow.com/questions/28016578/how-can-i-parse-create-a-date-time-stamp-formatted-with-fractional-seconds-utc
# https://serverfault.com/questions/1020446/linux-get-utc-offset-from-current-or-other-timezones-on-given-date-and-time
# https://man7.org/linux/man-pages/man1/date.1.html
# ----------------
# Set the script to halt on errors
set -e
if [[ -z "$1" ]]; then
echo "USAGE: $ 1./correct_times video.mp4 --update --over-write"
exit 1
fi
# Get the movie name
MOVIE=$1
echo "${MOVIE}"
# need to use raw mode `-r` in jq call to return a raw string otherwise it will be trouble to deal with
CREATED=$(ffprobe -loglevel 0 -print_format json -show_format -show_streams "${MOVIE}" | jq -r .format.tags.creation_time)
if [[ -z "${CREATED}" ]]; then
echo "ERROR - No creation_time in metadata! ${MOVIE}"
exit 1
fi
echo
echo "Video Create Time (Zulu): ${CREATED}"
# Convert the creation time to local time
LOCALTIME=$(date --date="${CREATED}" "+%FT%T %z (%Z)")
echo "Video Create Time (local): ${LOCALTIME}"
echo "--------"
# strip the timezone from the string
STRIPPED=$(TZ=UTC date --date="${CREATED}" "+%FT%T")
echo "Video Create Time (without timezone):${STRIPPED}"
# Express the string in the local timezone
TO_LOCAL=$(date --date="${STRIPPED}" "+%FT%T %z (%Z)")
echo "Video Create Time (to local):${TO_LOCAL}"
echo "--------"
# convert the local time string to UTC
CONVERTED=$(TZ=UTC date --date="${TO_LOCAL}" "+%FT%T.%6NZ") # this is the correct time string
echo "Video Create Time (to UTC):${CONVERTED}"
echo
# Video Create Time (Zulu): 2022-06-28T12:34:27.000000Z
# Video Create Time (local): 2022-06-28T08:34:27 -0400 (EDT)
# --------
# Video Create Time (without timezone):2022-06-28T12:34:27
# Video Create Time (to local):2022-06-28T12:34:27 -0400 (EDT)
# --------
# Video Create Time (to UTC):2022-06-28T16:34:27.000000Z
# -----------
OUTPUT="${MOVIE%%.*}".corrected."${MOVIE##*.}"
if [ "${2:-"invalid"}" == "--update" ]; then
# Write the converted timezone to the video
echo "Updating metadata ${MOVIE} -> ${OUTPUT}"
ffmpeg -i "${MOVIE}" -c copy -metadata creation_time="${CONVERTED}" "${OUTPUT}"
if [ "${3:-"invalid"}" == "--over-write" ]; then
echo "Moving ${OUTPUT} -> ${MOVIE}"
mv "${OUTPUT}" "${MOVIE}"
else
echo "To overwrite the existing video, use --over-write"
fi
else
echo "To update the metadata use --update"
fi |
...
"attached_pic": 0,
"timed_thumbnails": 0
},
"tags": {
"creation_time": "2023-07-16T15:22:49.000000Z",
"language": "und",
"handler_name": "Core Media Video"
}
}
],
"format": {
"filename": "Dive2.mp4",
"nb_streams": 2,
"nb_programs": 0,
"format_name": "mov,mp4,m4a,3gp,3g2,mj2",
"format_long_name": "QuickTime / MOV",
"start_time": "0.000000",
"duration": "733.616217",
"size": "751679577",
"bit_rate": "8196978",
"probe_score": 100,
"tags": {
"major_brand": "mp42",
"minor_version": "1",
"compatible_brands": "isommp41mp42",
"creation_time": "2023-07-16T15:22:49.000000Z"
}
}
} |
Scripts
Script | Description |
---|---|
This script extracts the USAGE: ./correct_time.sh video.mp4 --update | |
Adds Timestamp in the top right hand corner of the video. USAGE: ./timestamp.sh video.mp4 | |
Sets the time to the local time specified and stores in the video as UTC. USAGE: ./setTime.sh video.mp4 '2023-06-13T19:23:59' --update |
References
Reference | URL |
---|---|
Add Timestamp to Videos | |
Merging Chaptered GoPro Videos Whilst Preserving Telemetry | Trek View |