Additional TMC provider for MIB2 Discover Pro Units (HereTraffic)

**MIG** · 12-12-2022, 10:55 AM

I am looking at that now; the databases the system loads are specified in the PRODUCT.NDS (unencrypted

) table."urBuildingBlockVersionTable" I can either try and re-pack the database or try loading the PRODUCT.NDS from v7 or the Europe map pack. I don't see any versioning in it; I will test it after work.

**MIG** · 12-12-2022, 04:40 PM

Ok got the TMC decoder to load up, still no messages on the display, but a lot more data in the logs.

To replicate, replace the PRODUCT.NDS from the v7 AUS maps, and add the TI.NDS file.

Code:

06:13:50.885     [Info] [J5e.Radio.AUDIO]	AMP Output DMA: fMaxOutLR = 0.000000
06:11:30.103     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	setProviderSet(1024), previous provider set was 0
06:13:50.886     [Info] [J5e.Radio.AUDIO]	AMP Output DMA: fMaxOutRR = 0.000000
06:13:50.887     [Info] [J5e.Radio.AUDIO]	AMP Output DMA: fMaxOutCenter = 0.000000
06:11:30.111    [Error] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Provider set not found!
06:13:50.888     [Info] [J5e.Radio.AUDIO]	AMP Output DMA: fMaxOutSubw = 0.000000
06:11:30.112     [Info] navi: 06:11:30.111	[Error]	[iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Provider set not found!
06:13:50.939     [Info] [J5e.Radio.System]	Car speed = 0
06:11:30.112     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	setProviderSet(0), previous provider set was 0
06:13:50.939     [Info] [J5e.Radio.System]	AmFm (RadioText): rtCutOffSpeed = 255, rtCutOffHysteresis = 0, tooltipUpdateLimitingAmFm = 0
06:11:30.113     [Info] [iMX6.Navi.tsd.info.traffic.persistence.PersistenceManager]	fireLoadEvent
06:11:30.113     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	onLoad.
06:13:50.939     [Info] [J5e.Radio.System]	Dab (DynamicLabel): dlCutOffSpeed = 255, dlHysteresis = 0, tooltipUpdateLimitingDab = 0
06:11:30.116     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	Current time is Mo 12.12.2022 06:11:30
06:13:50.939     [Info] [J5e.Radio.System]	Dab (SlideShow): slsCutOffSpeed = 6, slsHysteresis = 2, slsDisplayTime1 = 0, slsDisplayTime2 = 20, slsDisplayTime = 0
06:11:30.117     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	processing line: 
06:13:50.962     [Info] [J5e.pm.listener]	send CARCOM_SYSTEM_COMMON 10 1 2 2 2 1 27 1 183314
06:11:30.117    [Error] [iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	Message not loaded, could not read timestamps.
06:13:50.966     [Info] [J5e.Radio.DataReceiverRds_TunerAmFm::Worker]	Added station name 'K-ROCK  ' to FmPresets; id={0xf99b60}; 
06:11:30.117     [Info] navi: 06:11:30.117	[Error]	[iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	Message not loaded, could not read timestamps.
06:13:50.972     [Info] [J5e.Radio.FmDivback-Q]	Quali| 95500000|76|99|3203/3203|2000|2000|  -3823758|  14506184|    0|     2
06:11:30.117     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	processing line: 
06:13:51.038     [Info] [J5e.cmsg.m30]	key: PQFront: Dimming sensor changed 169 -> 171

**ataylor** · 12-12-2022, 09:03 PM

@FlipperDog, would I also be able to get a copy of your v7 maps?

@MIG, So the error in your latest log, it is trying to set the "providerSet" to 1024, and then the ProviderManager is coming back saying set not found, and then resets itself back to 0, so either we have a syntax error in the TmcProviderSet.xml, or the providerSets are declared elsewhere as well.. I wonder if the PRODUCT.NDS or TI.NDS has some references?

what you might want to test is trying 1023 as an option, as that was an existing entry in the xml, and if that also declares a similar error. if that works, then we can either try 1024 again with just a single provider_ref entry in there, or try putting a provider_ref id from the 1024 list into the 1023 list...

I really wish my container would be delivered already so I could get my bench setup out and help test at the moment.

**ataylor** · 12-12-2022, 09:20 PM

Ok think I found the other location we might need to mod, there is a file called vw_default.cfg in \maps\22\cf\mapcfg\ which is just a zip file, inside is I think another zip file, not sure if its a zip or 7z is just showing it weird, but it has a copy of what is in the '\maps\22\cfg\mapcfg\VW' folder

I think we probably need to add the custom entries into there as well...

Edit: @MIG, what software are you using to explore the NDS database files? I was trying with DB browser with no luck

**MIG** · 13-12-2022, 08:17 AM

Originally Posted by ataylor

Edit: @MIG, what software are you using to explore the NDS database files? I was trying with DB browser with no luck

Bit of a hacky way at the moment, I am using this java software to convert the files to SQLite GitHub - 1e1/zipvfs-converter: Utility to convert ZIPVFS compressed SQLITE databases to a regular SQLITE file.

Then I use sqlite3.exe "PRODUCT.NDS.sqlite" ".recover" | sqlite3 PRODUCT.NDS.db to repair the files, as the decoder is not working 100%

Then the SQLite browser will open the files.

1023 got it going further, but it looks like it's not using the keys now

Code:

21:31:50.056     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	setProviderSet(1023), previous provider set was 0
21:31:50.063     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Provider set found, loading.

Code:

.TrafficManager]	enableDB setup TmcManager
	Line 23356: 21:31:45.675     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	dumpKnownLocationTables >>>
	Line 23357: 21:31:45.675     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:1, ltn:53, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23358: 21:31:45.675     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:2, ltn:54, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23359: 21:31:45.675     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:3, ltn:1, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23360: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:4, ltn:56, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23361: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:5, ltn:57, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23362: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:6, ltn:58, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23363: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:7, ltn:59, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23364: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:8, ltn:60, ltn version: 3.3) -> AU lang: en_Latn_GB
	Line 23365: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	(cc:9, ltn:41, ltn version: 5.0) -> NZ lang: en_Latn_GB
	Line 23366: 21:31:45.676     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcLocationTableManager]	dumpKnownLocationTables <<<

Code:

[Error] [iMX6.Navi.tsd.info.traffic.radio.RadioAccess]	addRadioStation: station (PI:3203, CC:3, ECC:0, LTN_transmitted:1, LTN_used:1, SID:1, EncryptionMode:full, ServiceKey:0, Encryption ID:22, src:FM, PS:K-ROCK  ) transmits undecodable TMC data 
	Line 48226: 21:36:21.515     [Info] navi: 21:36:21.514	[Error]	[iMX6.Navi.tsd.info.traffic.radio.RadioAccess]	addRadioStation: station (PI:3203, CC:3, ECC:0, LTN_transmitted:1, LTN_used:1, SID:1, EncryptionMode:full, ServiceKey:0, Encryption ID:22, src:FM, PS:K-ROCK  ) transmits undecodable TMC data

I did manage to dump the encryption keys out of the system root, but I am not sure what format they are in, I am looking into it more now

**kamold** · 13-12-2022, 09:57 AM

Originally Posted by ataylor

Ok think I found the other location we might need to mod, there is a file called vw_default.cfg in \maps\22\cf\mapcfg\ which is just a zip file, inside is I think another zip file, not sure if its a zip or 7z is just showing it weird, but it has a copy of what is in the '\maps\22\cfg\mapcfg\VW' folder

I think we probably need to add the custom entries into there as well...

I tried extracting all the files (7zip gives an unexpected end of archive error but WinRAR extracts without a warning) and then modifying the tmc XML files, however when re-zipping them the resultant file size (after the second compression) is larger (4223kb vs 3935kb). Even with deflate set to ultra compression. Removed some superfluous text from the edited files to get them to the same size on disk as the originals but the compression still ends up slightly larger. And this causes the MIB to give Navigation Database Unavailable error. Might need to try with gzip.

**MIG** · 13-12-2022, 10:12 AM

I don't have the full set of files from V7, but you try loading those provider set files that include the old 1024 set.

**MIG** · 13-12-2022, 05:56 PM

So I found a workaround for the weird compressed XML files.
If you are using the MIB STD2 Toolbox, you can dump the NAV graphics; this also dumps the XML files where they are stored while in use tsd\var\nav\cfg\mapcfg
Then you paste ataylor's files into the dump folder and use the toolbox to re-upload them.
This has got me very close now; I don't see anything in the logs that would prevent it from working.

Code:

06:15:02.512     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Provider set found, loading.

06:15:02.526     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	prepareFilteredLocationTables >>>
06:15:02.527     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	prepareFilteredLocationTables <<<
06:15:02.528     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	initTables
06:15:02.528     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 0
06:15:02.529     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 1
06:15:02.529     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 2
06:15:02.529     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 3
06:15:02.529     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 4
06:15:02.529     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 5
06:15:02.530     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 6
06:15:02.530     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ServiceKeyManager]	Loading service key table 7
06:15:02.531     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcMessagePersistence]	created.
06:15:02.544     [Info] [iMX6.Navi.tsd.info.traffic.tpeg.TpegDecoder]	Activate application decoder: TEC_TMC
06:15:02.558     [Info] [iMX6.Navi.tsd.info.traffic.tpeg.TpegDecoder]	Activate location decoder: TMCLoc
06:15:02.558     [Info] [iMX6.Navi.tsd.info.traffic.tpeg.TpegDecoderLocationTmc]	created with priority=50
06:15:02.565     [Info] [iMX6.Navi.tsd.info.traffic.tpeg.TpegLibraryManager]	Enable TPEG_LRC_TMC
06:15:02.594     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:   4 -> RefreshTmcTablesEventHandler
06:15:02.595     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:  46 -> RequestTmcWindowEventHandler
06:15:02.596     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:  49 -> UpdateTmcStateEventHandler
06:15:02.596     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:  53 -> UpdateTmcStateEventHandler
06:15:02.596     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:  56 -> GetTmcMessageHandler
06:15:02.596     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:  51 -> TmcMessagesAheadHandler
06:15:02.596     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event registered:  29 -> TmcMessagesAheadHandler
06:15:02.597     [Info] [iMX6.Navi.tsd.info.traffic.EventDispatcher]	Handler for event unregistered:  29 -> TmcMessagesAheadHandler
06:15:02.607    [Debug] [iMX6.Navi.tsd.mibstd2.info.traffic.IpcDSITmc]	updateTmcStateResult(2)
06:15:02.607     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcXmlTextDecoder]	Loading texts for en_GB, unit system is 0
06:15:02.728     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcXmlTextDecoder]	1194 strings loaded.
06:15:02.740     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcXmlTextDecoder]	Loading supplementary texts for en_GB
06:15:02.880     [Info] [iMX6.Navi.tsd.info.traffic.tmc.TmcXmlTextDecoder]	217 strings loaded.
06:15:02.908     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	setProviderSet(1024), previous provider set was 0
06:15:02.943     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Provider set found, loading.
06:15:02.948    [Error] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderSet]	Provider with ID=15not found, ignoring this entry!
06:15:02.948     [Info] navi: 06:15:02.948	[Error]	[iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderSet]	Provider with ID=15not found, ignoring this entry!

06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA ACT with tmc table (CC=1, NDS_CC=1, LTN_transmitted=53, LTN_used=53, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA NSW with tmc table (CC=2, NDS_CC=2, LTN_transmitted=54, LTN_used=54, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.967     [Warn] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	No tmc table in NDS DB for pay tmc provider SUNA VIC
06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA QLD with tmc table (CC=4, NDS_CC=4, LTN_transmitted=56, LTN_used=56, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA SA with tmc table (CC=5, NDS_CC=5, LTN_transmitted=57, LTN_used=57, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA WA with tmc table (CC=6, NDS_CC=6, LTN_transmitted=58, LTN_used=58, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA TAS with tmc table (CC=7, NDS_CC=7, LTN_transmitted=59, LTN_used=59, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.967     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA NT with tmc table (CC=8, NDS_CC=8, LTN_transmitted=60, LTN_used=60, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.968     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider SUNA NZ with tmc table (CC=9, NDS_CC=9, LTN_transmitted=41, LTN_used=41, SID=1, Encryption_Mode=2, Service_Key=4)
06:15:02.968     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic ACT with tmc table (CC=1, NDS_CC=1, LTN_transmitted=53, LTN_used=53, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.968     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic NSW with tmc table (CC=2, NDS_CC=2, LTN_transmitted=54, LTN_used=54, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.969     [Warn] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	No tmc table in NDS DB for pay tmc provider HereTraffic VIC
06:15:02.969     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic QLD with tmc table (CC=4, NDS_CC=4, LTN_transmitted=56, LTN_used=56, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.970     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic SA with tmc table (CC=5, NDS_CC=5, LTN_transmitted=57, LTN_used=57, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.970     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic WA with tmc table (CC=6, NDS_CC=6, LTN_transmitted=58, LTN_used=58, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.970     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic TAS with tmc table (CC=7, NDS_CC=7, LTN_transmitted=59, LTN_used=59, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.970     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic NT with tmc table (CC=8, NDS_CC=8, LTN_transmitted=60, LTN_used=60, SID=7, Encryption_Mode=2, Service_Key=7)
06:15:02.971     [Info] [iMX6.Navi.tsd.info.traffic.tmc.providers.ProviderManager]	Enabling pay tmc provider HereTraffic NZ with tmc table (CC=9, NDS_CC=9, LTN_transmitted=41, LTN_used=41, SID=7, Encryption_Mode=2, Service_Key=7)

**kamold** · 13-12-2022, 06:30 PM

Great find @MIG!
Didn't think of trying the MIB2STD toolbox.
That's some thinking outside of the...MIB?

**ataylor** · 13-12-2022, 07:09 PM

Just be aware that MIB2STD toolbox only works on some units… e.g it doesn’t work on Delphi units

But great Find @MIG, I was thinking of that been been the next step as I was pretty sure that cfg must be copied over and extracted as it was a zipped file..

Thread: Additional TMC provider for MIB2 Discover Pro Units (HereTraffic)

Thread Tools

Search Thread

Display

Tags for this Thread

Bookmarks

Bookmarks

Posting Permissions