Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Reference: https://www.bluebill.net/timestamps.html

...


Table of Contents

Install Pre-Requisits

Install ffmpeg, coreutils and jq.

Code Block
./correctTime.sh DIVE_2_1_GH010089.MP4 
DIVE_2_1_GH010089.MP4

Video Create Time (Zulu):  2023-06-13T19:12:11.000000Z
Video Create Time (local): 2023-06-13T15:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T19:12:11
Video Create Time (to local):2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-13T23:12:11.000000Z

To update the metadata use --update

Set File Creation/Modified Date

Code Block
touch -t [[CC]YY]MMDDhhmm[.ss] <file>

ex:
touch -t 202306131924 Dive2.mp4

Code Block
touch -t 202306131924 Dive2.mp4

ls -l
rw-r--r-- 1 john john  751679577 Jun 13 19:24 Dive2.mp4

Get Video File Information

Code Block
ffprobe -loglevel 0 -print_format json -show_format -show_streams "${INPUT}" | jq -r .format.tags.creation_time
brew install ffmpeg
brew install coreutils
brew install jq


Joining the Videos While Preserving Metadata

First create a text file (e.g. filesToMerge.txt) with all the chaptered video files that you want to merge into a single video e.g.

Code Block
file GH010097.MP4
file GH020097.MP4
file GH030097.MP4
file GH040097.MP4 


Next, check the streams in the video files.

Code Block
themeEmacs
ffprobe -show_format GH010097.MP4
Code Block
  Stream #0:0[0x1](eng): Video: h264 (High) (avc1 / 0x31637661), yuvj420p(pc, bt709, progressive), 2704x1520 [SAR 1:1 DAR 169:95], 60002 kb/s, 59.94 fps, 59.94 tbr, 60k tbn (default)
    Metadata:
      creation_time   : 2023-08-09T17:39:29.000000Z
      handler_name    : GoPro AVC  
      vendor_id       : [0][0][0][0]
Code Block
{
    "streams": [
      encoder  {
       : GoPro AVC encoder
  "index": 0,
   timecode         "codec_name": "aac",: 17:38:25:34
            "codec_long_name": "AAC (Advanced Audio Coding)",Stream #0:1[0x2](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 189 kb/s (default)
    Metadata:
      creation_time   "profile": "LC",: 2023-08-09T17:39:29.000000Z
      handler_name      "codec_type": "audio",
GoPro AAC  
         "codec_time_base": "1/48000",
vendor_id       : [0][0][0][0]
     "codec_tag_string": "mp4a",
 timecode        : 17:38:25:34
   "codec_tag": "0x6134706d",
     Stream #0:2[0x3](eng): Data: none (tmcd / 0x64636D74) (default)
    Metadata:
   "sample_fmt": "fltp",
  creation_time   : 2023-08-09T17:39:29.000000Z
      "sample_rate": "48000",
handler_name    : GoPro TCD  
      "channels": 2,
timecode        : 17:38:25:34
  Stream  "channel_layout": "stereo",
            "bits_per_sample": 0,#0:3[0x4](eng): Data: bin_data (gpmd / 0x646D7067), 49 kb/s (default)
    Metadata:
      creation_time      "r_frame_rate": "0/0",
: 2023-08-09T17:39:29.000000Z
      handler_name    : GoPro  "avg_frame_rate": "0/0",MET  
  Stream #0:4[0x5](eng): Data: none (fdsc / 0x63736466), 13 kb/s (default)
  "time_base": "1/48000",
            "start_pts": 0, Metadata:
      creation_time      "start_time": "0.000000",: 2023-08-09T17:39:29.000000Z
      handler_name      "duration_ts": 35213578,
GoPro SOS 


The above video has 4 streams. Lets try to join streams 0,1 and 3.

Code Block
themeEmacs
ffmpeg -f concat -safe 0 -i filesToMerge.txt -c copy -map 0:0 -map 0:1 -map 0:3 -c:v libx264 -pix_fmt yuv420p video-merged.mp4


Revise Scripts

Using the scripts from https://www.bluebill.net/timestamps.html

Revise timestamp.sh and correctTime.sh to use 'gdate' instead of 'date'.  

See below for revised scripts. 


Fixing GoPro Video Creation Time


Check Creation Time

Code Block
./correctTime.sh DIVE_2_1_GH010089.MP4 
DIVE_2_1_GH010089.MP4

Video Create Time (Zulu):  2023-06-13T19:12:11.000000Z
Video Create Time (local): 2023-06-13T15:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T19:12:11
Video Create Time (to local):2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-13T23:12:11.000000Z

To update the metadata use --update

In the above output we see that the local time was recorded as Zulu time.  The local time was 19:12:11.


Fix Creation Time

Code Block
./correctTime.sh DIVE_2_1_GH010089.MP4 --update


Verify Creation Time

Code Block
./correctTime.sh DIVE_2_1_GH010089.corrected.MP4 
DIVE_2_1_GH010089.corrected.MP4

Video Create Time (Zulu):  2023-06-13T23:12:11.000000Z
Video Create Time (local): 2023-06-13T19:12:11 -0400 (EDT)
--------
Video Create Time (without timezone):2023-06-13T23:12:11
Video Create Time (to local):2023-06-13T23:12:11 -0400 (EDT)
--------
Video Create Time (to UTC):2023-06-14T03:12:11.000000Z

To update the metadata use --update


Command to Update Creation Time:

Code Block
ffmpeg -I <MOVIE> -c copy -metadata creation_time=2023-06-13-23:12:11.000000Z <OUTPUT>


Add Timestamp to Video

Code Block
./timestamp.sh DIVE_2_1_GH010089.corrected.MP4


Changes to the timestamp.sh script:

  • Removed -vcodec libx265
  • Changed location of timestamp to top right corner


Code Block
...
#ffmpeg -i "${INPUT}" -vf drawtext="fontsize=30:fontcolor=yellow:text='%{pts\:localtime\:${EPOCH}}':x=(w-text_w) - 10:y=(h-text_h) - 10" -vcodec libx265 -crf 28 "${OUTPUT}"

ffmpeg -i "${INPUT}" -vf drawtext="fontsize=30:fontcolor=white:text='%{pts\:localtime\:${EPOCH}}':x=(w-text_w) - 10:y=10" -crf 28 "${OUTPUT}"
...


Get Video File Information

Code Block
ffprobe -loglevel 0 -print_format json -show_format -show_streams <VIDEO_FILE> 
Code Block
{
    "streams": [
        {
           "duration": "733.616208",
            "bit_rate": "119736",
            "max_bit_rate": "128000",
            "nb_frames": "34391",
            "disposition": {
                "default": 1,
                "dub": 0,
                "original": 0,
                "comment": 0,
                "lyrics": 0,
                "karaoke": 0,
                "forced": 0,
                "hearing_impaired": 0,
                "visual_impaired": 0,
                "clean_effects": 0,
                "attached_picindex": 0,
                "timedcodec_thumbnailsname": 0"aac",
            }"codec_long_name": "AAC (Advanced Audio Coding)",
            "tagsprofile": {"LC",
                "creationcodec_timetype": "2023-07-16T15:22:49.000000Zaudio",
                "language"codec_time_base": "eng1/48000",
                "handlercodec_tag_namestring": "Coremp4a",
 Media Audio"
          "codec_tag":  }
"0x6134706d",
             }"sample_fmt": "fltp",
        {     "sample_rate": "48000",
            "indexchannels": 12,
            "codecchannel_namelayout": "h264stereo",
            "codecbits_longper_namesample": "H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10",
0,
                    "profile"r_frame_rate": "High0/0",
            "codecavg_frame_typerate": "video0/0",
            "codec_time_base": "10011/12000048000",
            "codecstart_tag_stringpts": "avc1"0,
            "codecstart_tagtime": "0x316376610.000000",
            "widthduration_ts": 128035213578,
            "heightduration": 720"733.616208",
            "codedbit_widthrate": 1280"119736",
            "codedmax_bit_heightrate": 720"128000",
            "hasnb_b_frames": 0"34391",
            "sample_aspect_ratiodisposition": "1:1",
{
                "display_aspect_ratiodefault": "16:9"1,
                "pix_fmtdub": "yuv420p"0,
                "leveloriginal": 320,
            "color_range    "comment": "tv"0,
            "color_space    "lyrics": "bt709"0,
                "color_transferkaraoke": "bt709"0,
                "color_primariesforced": "bt709"0,
                "chromahearing_locationimpaired": "left"0,
                "fieldvisual_orderimpaired": "progressive"0,
            "refs    "clean_effects": 10,
                "isattached_avcpic": "true"0,
                "naltimed_length_sizethumbnails": "4",0
            "r_frame_rate": "60000/1001"},
            "avg_frame_ratetags": "60000/1001",
{
                "creation_time_base": "1/60000"2023-07-16T15:22:49.000000Z",
            "start_pts    "language": 0"eng",
                "starthandler_timename": "0.000000",
Core Media Audio"
             "duration_ts": 44016973,
}
        },
       "duration": "733.616217", {
            "bit_rateindex": "8069838"1,
            "bits_per_raw_samplecodec_name": "8h264",
            "nbcodec_long_framesname": "43973H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10",
            "dispositionprofile": {"High",
                "default"codec_type": 1"video",
                "dub"codec_time_base": 0"1001/120000",
                "original": 0"codec_tag_string": "avc1",
                "comment"codec_tag": 0"0x31637661",
                "lyricswidth": 01280,
                "karaokeheight": 0720,
                "forcedcoded_width": 01280,
                "hearingcoded_impairedheight": 0720,
                "visualhas_b_impairedframes": 0,
                "clean_effects"sample_aspect_ratio": 0"1:1",
                "attached_pic"display_aspect_ratio": 0"16:9",
                "timedpix_thumbnailsfmt": 0"yuv420p",
            "level": }32,
            "tagscolor_range": {
  "tv",
              "creationcolor_timespace": "2023-07-16T15:22:49.000000Zbt709",
                "language"color_transfer": "undbt709",
                "handlercolor_nameprimaries": "Core Media Videobt709",
            }
"chroma_location": "left",
         }
    ],
"field_order": "progressive",
            "formatrefs": {1,
        "filename    "is_avc": "Dive2.mp4true",
        "nb_streams    "nal_length_size": 2"4",
        "nb_programs    "r_frame_rate": 0"60000/1001",
        "format_name    "avg_frame_rate": "mov,mp4,m4a,3gp,3g2,mj260000/1001",
            "formattime_long_namebase": "QuickTime 1/ MOV60000",
            "start_timepts": "0.000000",
            "durationstart_time": "7330.616217000000",
            "sizeduration_ts": "751679577"44016973,
        "bit_rate    "duration": "8196978733.616217",
            "probebit_scorerate": 100"8069838",
        "tags    "bits_per_raw_sample": {"8",
            "majornb_brandframes": "mp4243973",
            "minor_version": "1"disposition": {
                "default": 1,
            "compatible_brands    "dub": "isommp41mp42"0,
                "creation_timeoriginal": "2023-07-16T15:22:49.000000Z"
0,
           }
     }
}

Scripts

Code Block
languagebash
titletimestamp.sh
collapsetrue
#!/usr/bin/env bash

# -----------
# SPDX-License-Identifier: MIT
# Copyright (c) 2022 Troy Williams

# uuid       = 70204dea-f8b9-11ec-a408-cbfc46763958
# author"comment": 0,
                "lyrics": 0,
               = Troy Williams
# email"karaoke": 0,
       = troy.williams@bluebill.net
# date       = 2022-06-30
# -----------

# this script will add timestamps (like security cameras) to the bottom left
# corner of the video. It will use the creation date as the starting point of
# the timestamp counter. The output video will be re-encoded to h265 format.

# NOTE: Some videos indicate they are in UTC, but in fact are not.They will need
# be correct otherwise the timestamp will be incorrect.

# NOTE: If the creation_time isn't set, the video will be skipped.

# Usage:

# $ ./timestamp.sh 20210613_191928.mp4

# loop through files in a folder:
# $ for FILE in ./2022-06-28/*; do ./timestamp.sh "${FILE}"; done
# $ for FILE in ./2022-06-28/*; do ./timestamp.sh "${FILE}" --over-write; done

# Requirements:

# JSON parser: $ sudo apt install jq

# References

# https://www.cyberciti.biz/faq/unix-linux-bsd-appleosx-bash-assign-variable-command-output/
# https://stackoverflow.com/questions/1955505/parsing-json-with-unix-tools
# https://www.baeldung.com/linux/use-command-line-arguments-in-bash-script
# https://stackoverflow.com/a/965069
# https://www.howtogeek.com/529219/how-to-parse-json-files-on-the-linux-command-line-with-jq/
# https://cameronnokes.com/blog/working-with-json-in-bash-using-jq/
# https://stackoverflow.com/questions/965053/extract-filename-and-extension-in-bash

# https://ourcodeworld.com/articles/read/1484/how-to-get-the-information-and-metadata-of-a-media-file-audio-or-video-in-json-format-with-ffprobe
# ffprobe -loglevel 0 -print_format json -show_format -show_streams GX013438.MP4

# ----------------
# Set the script to halt on errors
set -e

if [[ -z "$1" ]]; then
    echo "USAGE: $ 1./timestamp.sh video.mp4"
    exit 1
fi

# Get the movie name
# MOVIE=${1}

# What is the full path of the movie name?
INPUT=$(readlink -f "$1")

# Strip longest match of */ from start
filename="${INPUT##*/}"

# Substring from 0 thru pos of filename
dir="${INPUT:0:${#INPUT} - ${#filename}}"

# Strip shortest match of . plus at least one non-dot char from end
base="${filename%.[^.]*}"

# Substring from len of base thru end
ext="${filename:${#base} + 1}"

# If we have an extension and no base, it's really the base
if [[ -z "$base" && -n "$ext" ]]; then
    base=".$ext"
    ext=""
fi

# Create the new file name
OUTPUT="${dir}"/"${base}".stamped."${ext}"

# ----------
# Debugging Code
# echo "MOVIE = ${MOVIE}"
# echo "INPUT = ${INPUT}"
# echo "filename = ${filename}"
# echo "dir = ${dir}"
# echo "base = ${base}"
# echo "ext = ${ext}"
# echo "OUTPUT = ${OUTPUT}"
# ----------

# need to use raw mode `-r` in jq call to return a raw string otherwise it will
# be trouble to deal with
STARTDATE=$(ffprobe -loglevel 0 -print_format json -show_format -show_streams "${INPUT}" | jq -r .format.tags.creation_time)

if [[ -z "${STARTDATE}" ]]; then
    echo "ERROR - No creation_time in metadata! ${INPUT}"
    exit 1
fi

# Convert the date to EPOCH. This will be used to set the time for the draw text
# method.
EPOCH=$(date --date="${STARTDATE}" +%s)

echo "Video Create Time: ${STARTDATE} (${EPOCH})"

# we assume that the STARTDATE is in UTC 0000, Zulu time, GMT and that we want
# to convert it to the local time on the computer.
ffmpeg -i "${INPUT}" -vf drawtext="fontsize=30:fontcolor=yellow:text='%{pts\:localtime\:${EPOCH}}':x=(w-text_w) - 10:y=(h-text_h) - 10" -vcodec libx265 -crf 28 "${OUTPUT}"

if [ "${3:-"invalid"}" == "--over-write" ]; then

    echo "Moving ${OUTPUT} -> ${INPUT}"
    mv "${OUTPUT}" "${INPUT}"

else
    echo "To overwrite the existing video, use --over-write"
fi
Code Block
languagebash
titlecorrect_times.sh
collapsetrue
#!/usr/bin/env bash

# -----------
# SPDX-License-Identifier: MIT
# Copyright (c) 2022 Troy Williams

# uuid       = e577e81c-f938-11ec-9c1a-0d95d112ee30
# author     = Troy Williams
# email      = troy.williams@bluebill.net
# date       = 2022-07-01
# -----------

# This script will take the video and correct the creation time issue with it.
# It assumes that the the creation time did not have the proper timezone set.
# This means that other programs will attempt to convert from GMT/Zulu time and
# get the wrong time stamp.

# This script assumes that the video has the correct local time, but was
# inserted without a timezone. It will extract that time, and configure it as a
# local time. It will then convert the local time properly to UTC +00:00 and
# write it back to the video.

# Generally this script would be executed before the `timestamp.sh` script.

#NOTE: This script should only be run if the timestamps stored in the video are
#not correctly set to UTC time.

# Usage:

# List the creation time and what it would be in local time:
# $ ./correct_times.sh GX013443.MP4

# Write the corrected local time to the video.
# $ ./correct_times.sh GX013443.MP4 --update

# Write the corrected local time to the video.and overwrite the existing file
# $ ./correct_times.sh GX013443.MP4 --update --over-write

# loop through files in a folder:
# $ for FILE in ./2022-06-28/*; do ./correct_times.sh "${FILE}"; done
# $ for FILE in ./2022-06-28/*; do ./correct_times.sh "${FILE}" --update; done
# $ for FILE in ./2022-06-28/*; do ./correct_times.sh "${FILE}" --update --over-write; done


# Requirements:

# JSON parser: $ sudo apt install jq

# References

# https://stackoverflow.com/questions/16548528/command-to-get-time-in-milliseconds
# https://stackoverflow.com/questions/28016578/how-can-i-parse-create-a-date-time-stamp-formatted-with-fractional-seconds-utc
# https://serverfault.com/questions/1020446/linux-get-utc-offset-from-current-or-other-timezones-on-given-date-and-time
# https://man7.org/linux/man-pages/man1/date.1.html

# ----------------
# Set the script to halt on errors
set -e

if [[ -z "$1" ]]; then
    echo "USAGE: $ 1./correct_times video.mp4 --update --over-write"
    exit 1
fi

# Get the movie name
MOVIE=$1

echo "${MOVIE}"
# need to use raw mode `-r` in jq call to return a raw string otherwise it will be trouble to deal with
CREATED=$(ffprobe -loglevel 0 -print_format json -show_format -show_streams "${MOVIE}" | jq -r .format.tags.creation_time)

if [[ -z "${CREATED}" ]]; then
    echo "ERROR - No creation_time in metadata! ${MOVIE}"
    exit 1
fi

echo
echo "Video Create Time (Zulu):  ${CREATED}"

# Convert the creation time to local time
LOCALTIME=$(date --date="${CREATED}" "+%FT%T %z (%Z)")
echo "Video Create Time (local): ${LOCALTIME}"

echo "--------"
# strip the timezone from the string
STRIPPED=$(TZ=UTC date --date="${CREATED}" "+%FT%T")
echo "Video Create Time (without timezone):${STRIPPED}"

# Express the string in the local timezone
TO_LOCAL=$(date --date="${STRIPPED}" "+%FT%T %z (%Z)")
echo "Video Create Time (to local):${TO_LOCAL}"

echo "--------"
# convert the local time string to UTC
CONVERTED=$(TZ=UTC date --date="${TO_LOCAL}" "+%FT%T.%6NZ") # this is the correct time string
echo "Video Create Time (to UTC):${CONVERTED}"
echo

# Video Create Time (Zulu):  2022-06-28T12:34:27.000000Z
# Video Create Time (local): 2022-06-28T08:34:27 -0400 (EDT)
# --------
# Video Create Time (without timezone):2022-06-28T12:34:27
# Video Create Time (to local):2022-06-28T12:34:27 -0400 (EDT)
# --------
# Video Create Time (to UTC):2022-06-28T16:34:27.000000Z

# -----------

OUTPUT="${MOVIE%%.*}".corrected."${MOVIE##*.}"

if [ "${2:-"invalid"}" == "--update" ]; then

    # Write the converted timezone to the video
    echo "Updating metadata ${MOVIE} -> ${OUTPUT}"
    ffmpeg -i "${MOVIE}" -c copy -metadata creation_time="${CONVERTED}" "${OUTPUT}"

    if [ "${3:-"invalid"}" == "--over-write" ]; then

        echo "Moving ${OUTPUT} -> ${MOVIE}"
        mv "${OUTPUT}" "${MOVIE}"

    else
        echo "To overwrite the existing video, use --over-write"
    fi

else
    echo "To update the metadata use --update"
fi
"forced": 0,
                "hearing_impaired": 0,
                "visual_impaired": 0,
                "clean_effects": 0,
                "attached_pic": 0,
                "timed_thumbnails": 0
            },
            "tags": {
                "creation_time": "2023-07-16T15:22:49.000000Z",
                "language": "und",
                "handler_name": "Core Media Video"
            }
        }
    ],
    "format": {
        "filename": "Dive2.mp4",
        "nb_streams": 2,
        "nb_programs": 0,
        "format_name": "mov,mp4,m4a,3gp,3g2,mj2",
        "format_long_name": "QuickTime / MOV",
        "start_time": "0.000000",
        "duration": "733.616217",
        "size": "751679577",
        "bit_rate": "8196978",
        "probe_score": 100,
        "tags": {
            "major_brand": "mp42",
            "minor_version": "1",
            "compatible_brands": "isommp41mp42",
            "creation_time": "2023-07-16T15:22:49.000000Z"
        }
    }
}


Scripts

ScriptDescription 

This script extracts the creation_time, removes the timezone and assigns the local timezone. It then converts this back to UTC and write it back to the video. This fixes issue with GoPro Videos.

USAGE: ./correct_time.sh video.mp4 --update 

Adds Timestamp in the top right hand corner of the video.

USAGE: ./timestamp.sh video.mp4

Sets the time to the local time specified and stores in the video as UTC.

USAGE: ./setTime.sh video.mp4 '2023-06-13T19:23:59' --update


References

ReferenceURL
Add Timestamp to Videos

https://www.bluebill.net/timestamps.html

Merging Chaptered GoPro Videos Whilst Preserving Telemetry | Trek View

...