Allow to escape only unicode chars

[Dictionary.git] / dictionary-format-v6.txt

diff --git a/dictionary-format-v6.txt b/dictionary-format-v6.txt
index 17cbe23f36e7e7edf13e08d571a46c0c019a92ce..06941cccff6db756412e8850763ca865506e0323 100644 (file)
--- a/dictionary-format-v6.txt
+++ b/dictionary-format-v6.txt
@@ -1,7 +1,10 @@
 This is a quick write-up of the old dictionary file format, v6.
 This is a quick write-up of the old dictionary file format, v6.

+It is the format that is (unfortunately) still used by the Tolino
+ebook readers. The ConvertToV6 tool can be used to convert
+the new format to this old one.

 v6 is troublesome as it relies on Java serialization and thus
 there will be references to Java types.
 v6 is troublesome as it relies on Java serialization and thus
 there will be references to Java types.

-This hasn't been checked for correctness and likely has some bugs.
+This hasn't been checked much for correctness and likely has some bugs.

 Also, I really should have used some standard format for writing this...
 
 ===========================================
 Also, I really should have used some standard format for writing this...
 
 ===========================================


@@ -156,3 +159,46 @@ list_of([Int]) list of indices into list_of(html_entry) (since v6)
 3: index into list_of([text_entry])
 4: index into list_of([index_entry]) (mark as "extra info/translation" entry)
 5: index into list_of([html_entry])
 3: index into list_of([text_entry])
 4: index into list_of([index_entry]) (mark as "extra info/translation" entry)
 5: index into list_of([html_entry])

+
+=======================================
+
+Set<String>
+
+Java serialization of java.util.HashSet.
+First part consists always the same 40 bytes:
+    0xac, 0xed, // magic
+    0x00, 0x05, // version
+    0x73, // object
+    0x72, // class
+    // Java String "java.util.HashSet"
+    0x00, 0x11, 0x6a, 0x61, 0x76, 0x61, 0x2e, 0x75, 0x74, 0x69,
+    0x6c, 0x2e, 0x48, 0x61, 0x73, 0x68, 0x53, 0x65, 0x74,
+    // serialization ID
+    0xba, 0x44, 0x85, 0x95, 0x96, 0xb8, 0xb7, 0x34,
+    0x03, // flags: serialized, custom serialization function
+    0x00, 0x00, // fields count
+    0x78, // blockdata end
+    0x70, // null (superclass)
+    0x77, 0x0c // blockdata short, 0xc bytes
+
+[Int]: capacity. Not used for anything, but set to >= <num_entries>
+[Float]: capacity factor. May affect performance of old QuickDic versions, set to 0.75f
+[Int]: <num_entries>
+<num_entries> times:
+    1 byte 0x74: String type
+    [String]: stop word
+1 byte 0x78: blockdata end
+
+Note: Some even older dictionaries wrote out a LinkedHashSet instead of a
+HashSet.
+That adds the following bytes describing LinkedHashSet before the 0x72 above:
+    0x72, // class
+    // Java String "java.util.LinkedHashSet"
+    0x00, 0x17, 0x6a, 0x61, 0x76, 0x61, 0x2e, 0x75, 0x74, 0x69,
+    0x6c, 0x2e, 0x4c, 0x69, 0x6e, 0x6b, 0x65, 0x64, 0x48, 0x61,
+    0x73, 0x68, 0x53, 0x65, 0x74,
+    // serialization ID
+    0xd8, 0x6c, 0xd7, 0x5a, 0x95, 0xdd, 0x2a, 0x1e,
+    0x02, // flags
+    0x00, 0x00, // fields count
+    0x78 // blockdata end