]> git.proxmox.com Git - mirror_ubuntu-artful-kernel.git/blame - fs/ntfs/ChangeLog
NTFS: Remove address space operations ->prepare_write and ->commit_write in
[mirror_ubuntu-artful-kernel.git] / fs / ntfs / ChangeLog
CommitLineData
1da177e4
LT
1ToDo/Notes:
2 - Find and fix bugs.
1da177e4 3 - In between ntfs_prepare/commit_write, need exclusion between
66129f88
AA
4 simultaneous file extensions. This is given to us by holding i_sem
5 on the inode. The only places in the kernel when a file is resized
dd072330
AA
6 are prepare/commit write and ntfs_truncate() for both of which i_sem
7 is held. Just have to be careful in read-/writepage and other helpers
8 not running under i_sem that we play nice... Also need to be careful
9 with initialized_size extention in ntfs_prepare_write and writepage.
10 UPDATE: The only things that need to be checked are
11 prepare/commit_write as well as the compressed write and the other
12 attribute resize/write cases like index attributes, etc. For now
13 none of these are implemented so are safe.
1da177e4
LT
14 - Implement mft.c::sync_mft_mirror_umount(). We currently will just
15 leave the volume dirty on umount if the final iput(vol->mft_ino)
16 causes a write of any mirrored mft records due to the mft mirror
17 inode having been discarded already. Whether this can actually ever
18 happen is unclear however so it is worth waiting until someone hits
19 the problem.
20 - Enable the code for setting the NT4 compatibility flag when we start
21 making NTFS 1.2 specific modifications.
22
fd9d6367
AA
232.1.25-WIP
24
511bea5e
AA
25 - Change ntfs_map_runlist_nolock(), ntfs_attr_find_vcn_nolock() and
26 {__,}ntfs_cluster_free() to also take an optional attribute search
27 context as argument. This allows calling these functions with the
28 mft record mapped. Update all callers.
29 - Fix potential deadlock in ntfs_mft_data_extend_allocation_nolock()
30 error handling by passing in the active search context when calling
31 ntfs_cluster_free().
fc0fa7dc
AA
32 - Change ntfs_cluster_alloc() to take an extra boolean parameter
33 specifying whether the cluster are being allocated to extend an
34 attribute or to fill a hole.
35 - Change ntfs_attr_make_non_resident() to call ntfs_cluster_alloc()
36 with @is_extension set to TRUE and remove the runlist terminator
37 fixup code as this is now done by ntfs_cluster_alloc().
8925d4f0
AA
38 - Change ntfs_attr_make_non_resident to take the attribute value size
39 as an extra parameter. This is needed since we need to know the size
40 before we can map the mft record and our callers always know it. The
41 reason we cannot simply read the size from the vfs inode i_size is
42 that this is not necessarily uptodate. This happens when
43 ntfs_attr_make_non_resident() is called in the ->truncate call path.
2a6fc4e1
AA
44 - Fix ntfs_attr_make_non_resident() to update the vfs inode i_blocks
45 which is zero for a resident attribute but should no longer be zero
46 once the attribute is non-resident as it then has real clusters
47 allocated.
2d86829b
AA
48 - Add fs/ntfs/attrib.[hc]::ntfs_attr_extend_allocation(), a function to
49 extend the allocation of an attributes. Optionally, the data size,
50 but not the initialized size can be extended, too.
dd072330
AA
51 - Implement fs/ntfs/inode.[hc]::ntfs_truncate(). It only supports
52 uncompressed and unencrypted files.
e9438250
AA
53 - Enable ATTR_SIZE attribute changes in ntfs_setattr(). This completes
54 the initial implementation of file truncation. Now both open(2)ing
55 a file with the O_TRUNC flag and the {,f}truncate(2) system calls
56 will resize a file appropriately. The limitations are that only
57 uncompressed and unencrypted files are supported. Also, there is
58 only very limited support for highly fragmented files (the ones whose
59 $DATA attribute is split into multiple attribute extents).
29b89905
AA
60 - In attrib.c::ntfs_attr_set() call balance_dirty_pages_ratelimited()
61 and cond_resched() in the main loop as we could be dirtying a lot of
62 pages and this ensures we play nice with the VM and the system as a
63 whole.
fd9d6367 64
7d333d6c 652.1.24 - Lots of bug fixes and support more clean journal states.
e7a1033b
AA
66
67 - Support journals ($LogFile) which have been modified by chkdsk. This
68 means users can boot into Windows after we marked the volume dirty.
69 The Windows boot will run chkdsk and then reboot. The user can then
70 immediately boot into Linux rather than having to do a full Windows
71 boot first before rebooting into Linux and we will recognize such a
5a8c0cc3
AA
72 journal and empty it as it is clean by definition. Note, this only
73 works if chkdsk left the journal in an obviously clean state.
e7a1033b
AA
74 - Support journals ($LogFile) with only one restart page as well as
75 journals with two different restart pages. We sanity check both and
76 either use the only sane one or the more recent one of the two in the
77 case that both are valid.
06d0e3cf
AA
78 - Add fs/ntfs/malloc.h::ntfs_malloc_nofs_nofail() which is analogous to
79 ntfs_malloc_nofs() but it performs allocations with __GFP_NOFAIL and
80 hence cannot fail.
9529d461
AA
81 - Use ntfs_malloc_nofs_nofail() in the two critical regions in
82 fs/ntfs/runlist.c::ntfs_runlists_merge(). This means we no longer
83 need to panic() if the allocation fails as it now cannot fail.
84d6ebe6
AA
84 - Fix two nasty runlist merging bugs that had gone unnoticed so far.
85 Thanks to Stefano Picerno for the bug report.
8bb73521 86 - Remove two bogus BUG_ON()s from fs/ntfs/mft.c.
2b0ada2b
AA
87 - Fix handling of valid but empty mapping pairs array in
88 fs/ntfs/runlist.c::ntfs_mapping_pairs_decompress().
f94ad38e
AA
89 - Report unrepresentable inodes during ntfs_readdir() as KERN_WARNING
90 messages and include the inode number. Thanks to Yura Pakhuchiy for
91 pointing this out.
3ffc5a44
AA
92 - Change ntfs_rl_truncate_nolock() to throw away the runlist if the new
93 length is zero.
6e48321a
AA
94 - Add runlist.[hc]::ntfs_rl_punch_nolock() which punches a caller
95 specified hole into a runlist.
8e08ceae
AA
96 - Fix a bug in fs/ntfs/index.c::ntfs_index_lookup(). When the returned
97 index entry is in the index root, we forgot to set the @ir pointer in
98 the index context. Thanks to Yura Pakhuchiy for finding this bug.
f25dfb5e 99 - Remove bogus setting of PageError in ntfs_read_compressed_block().
0aacceac 100 - Add fs/ntfs/attrib.[hc]::ntfs_resident_attr_value_resize().
2983d1bd
AA
101 - Fix a bug in ntfs_map_runlist_nolock() where we forgot to protect
102 access to the allocated size in the ntfs inode with the size lock.
103 - Fix ntfs_attr_vcn_to_lcn_nolock() and ntfs_attr_find_vcn_nolock() to
104 return LCN_ENOENT when there is no runlist and the allocated size is
105 zero.
106 - Fix load_attribute_list() to handle the case of a NULL runlist.
807c453d
AA
107 - Fix handling of sparse attributes in ntfs_attr_make_non_resident().
108 - Add BUG() checks to ntfs_attr_make_non_resident() and ntfs_attr_set()
109 to ensure that these functions are never called for compressed or
110 encrypted attributes.
bbf1813f
AA
111 - Fix cluster (de)allocators to work when the runlist is NULL and more
112 importantly to take a locked runlist rather than them locking it
113 which leads to lock reversal.
1c7d469d
AA
114 - Truncate {a,c,m}time to the ntfs supported time granularity when
115 updating the times in the inode in ntfs_setattr().
67bb1037 116 - Fixup handling of sparse, compressed, and encrypted attributes in
311120ec
AA
117 fs/ntfs/inode.c::ntfs_read_locked_{,attr_,index_}inode(),
118 fs/ntfs/aops.c::ntfs_{read,write}page().
8dcdebaf
AA
119 - Make ntfs_write_block() not instantiate sparse blocks if they contain
120 only zeroes.
54b02eb0
AA
121 - Optimize fs/ntfs/aops.c::ntfs_write_block() by extending the page
122 lock protection over the buffer submission for i/o which allows the
123 removal of the get_bh()/put_bh() pairs for each buffer.
8273d5d4
AA
124 - Fix fs/ntfs/aops.c::ntfs_{read,write}_block() to handle the case
125 where a concurrent truncate has truncated the runlist under our feet.
a01ac532 126 - Fix page_has_buffers()/page_buffers() handling in fs/ntfs/aops.c.
e604635c
AA
127 - In fs/ntfs/aops.c::ntfs_end_buffer_async_read(), use a bit spin lock
128 in the first buffer head instead of a driver global spin lock to
129 improve scalability.
7d333d6c 130 - Minor fix to error handling and error message display in
5d46770f
AA
131 fs/ntfs/aops.c::ntfs_prepare_nonresident_write().
132 - Change the mount options {u,f,d}mask to always parse the number as
133 an octal number to conform to how chmod(1) works, too. Thanks to
134 Giuseppe Bilotta and Horst von Brand for pointing out the errors of
135 my ways.
5c9f6de3
AA
136 - Fix various bugs in the runlist merging code. (Based on libntfs
137 changes by Richard Russon.)
5a8c0cc3
AA
138 - Fix sparse warnings that have crept in over time.
139 - Change ntfs_cluster_free() to require a write locked runlist on entry
140 since we otherwise get into a lock reversal deadlock if a read locked
141 runlist is passed in. In the process also change it to take an ntfs
142 inode instead of a vfs inode as parameter.
143 - Fix the definition of the CHKD ntfs record magic. It had an off by
144 two error causing it to be CHKB instead of CHKD.
18efefa9
AA
145 - Fix a stupid bug in __ntfs_bitmap_set_bits_in_run() which caused the
146 count to become negative and hence we had a wild memset() scribbling
147 all over the system's ram.
e7a1033b 148
af859a42
AA
1492.1.23 - Implement extension of resident files and make writing safe as well as
150 many bug fixes, cleanups, and enhancements...
1da177e4
LT
151
152 - Add printk rate limiting for ntfs_warning() and ntfs_error() when
153 compiled without debug. This avoids a possible denial of service
154 attack. Thanks to Carl-Daniel Hailfinger from SuSE for pointing this
155 out.
8907547d 156 - Fix compilation warnings on ia64. (Randy Dunlap)
af859a42
AA
157 - Use i_size_{read,write}() instead of reading i_size by hand and cache
158 the value where apropriate.
36763677
AA
159 - Add size_lock to the ntfs_inode structure. This is an rw spinlock
160 and it locks against access to the inode sizes. Note, ->size_lock
161 is also accessed from irq context so you must use the _irqsave and
af859a42
AA
162 _irqrestore lock and unlock functions, respectively. Protect all
163 accesses to allocated_size, initialized_size, and compressed_size.
218357ff 164 - Minor optimization to fs/ntfs/super.c::ntfs_statfs() and its helpers.
946929d8
AA
165 - Implement extension of resident files in the regular file write code
166 paths (fs/ntfs/aops.c::ntfs_{prepare,commit}_write()). At present
167 this only works until the data attribute becomes too big for the mft
168 record after which we abort the write returning -EOPNOTSUPP from
169 ntfs_prepare_write().
c002f425
AA
170 - Add disable_sparse mount option together with a per volume sparse
171 enable bit which is set appropriately and a per inode sparse disable
172 bit which is preset on some system file inodes as appropriate.
173 - Enforce that sparse support is disabled on NTFS volumes pre 3.0.
1a0df15a
AA
174 - Fix a bug in fs/ntfs/runlist.c::ntfs_mapping_pairs_decompress() in
175 the creation of the unmapped runlist element for the base attribute
176 extent.
b6ad6c52
AA
177 - Split ntfs_map_runlist() into ntfs_map_runlist() and a non-locking
178 helper ntfs_map_runlist_nolock() which is used by ntfs_map_runlist().
179 This allows us to map runlist fragments with the runlist lock already
180 held without having to drop and reacquire it around the call. Adapt
181 all callers.
182 - Change ntfs_find_vcn() to ntfs_find_vcn_nolock() which takes a locked
183 runlist. This allows us to find runlist elements with the runlist
184 lock already held without having to drop and reacquire it around the
185 call. Adapt all callers.
37e4c13b 186 - Change time to u64 in time.h::ntfs2utc() as it otherwise generates a
d8ec785e
AA
187 warning in the do_div() call on sparc32. Thanks to Meelis Roos for
188 the report and analysis of the warning.
37e4c13b 189 - Fix a nasty runlist merge bug when merging two holes.
5ae9fcf8
AA
190 - Set the ntfs_inode->allocated_size to the real allocated size in the
191 mft record for resident attributes (fs/ntfs/inode.c).
192 - Small readability cleanup to use "a" instead of "ctx->attr"
193 everywhere (fs/ntfs/inode.c).
41382686
AA
194 - Make fs/ntfs/namei.c::ntfs_get_{parent,dentry} static and move the
195 definition of ntfs_export_ops from fs/ntfs/super.c to namei.c. Also,
196 declare ntfs_export_ops in fs/ntfs/ntfs.h.
9451f851
AA
197 - Correct sparse file handling. The compressed values need to be
198 checked and set in the ntfs inode as done for compressed files and
199 the compressed size needs to be used for vfs inode->i_blocks instead
200 of the allocated size, again, as done for compressed files.
271849a9
AA
201 - Add AT_EA in addition to AT_DATA to whitelist for being allowed to be
202 non-resident in fs/ntfs/attrib.c::ntfs_attr_can_be_non_resident().
203 - Add fs/ntfs/attrib.c::ntfs_attr_vcn_to_lcn_nolock() used by the new
204 write code.
c0c1cc0e
AA
205 - Fix bug in fs/ntfs/attrib.c::ntfs_find_vcn_nolock() where after
206 dropping the read lock and taking the write lock we were not checking
207 whether someone else did not already do the work we wanted to do.
208 - Rename fs/ntfs/attrib.c::ntfs_find_vcn_nolock() to
209 ntfs_attr_find_vcn_nolock() and update all callers.
2bfb4fff 210 - Add fs/ntfs/attrib.[hc]::ntfs_attr_make_non_resident().
43b01fda
AA
211 - Fix sign of various error return values to be negative in
212 fs/ntfs/lcnalloc.c.
905685f6
AA
213 - Modify ->readpage and ->writepage (fs/ntfs/aops.c) so they detect and
214 handle the case where an attribute is converted from resident to
215 non-resident by a concurrent file write.
251c8427
JJ
216 - Remove checks for NULL before calling kfree() since kfree() does the
217 checking itself. (Jesper Juhl)
b0d2374d
AA
218 - Some utilities modify the boot sector but do not update the checksum.
219 Thus, relax the checking in fs/ntfs/super.c::is_boot_sector_ntfs() to
220 only emit a warning when the checksum is incorrect rather than
221 refusing the mount. Thanks to Bernd Casimir for pointing this
222 problem out.
bb3cf335 223 - Update attribute definition handling.
7fafb8b6
AA
224 - Add NTFS_MAX_CLUSTER_SIZE and NTFS_MAX_PAGES_PER_CLUSTER constants.
225 - Use NTFS_MAX_CLUSTER_SIZE in super.c instead of hard coding 0x10000.
d53ee322
AA
226 - Use MAX_BUF_PER_PAGE instead of variable sized array allocation for
227 better code generation and one less sparse warning in fs/ntfs/aops.c.
2fb21db2 228 - Remove spurious void pointer casts from fs/ntfs/. (Pekka Enberg)
442d207e
AA
229 - Use C99 style structure initialization after memory allocation where
230 possible (fs/ntfs/{attrib.c,index.c,super.c}). Thanks to Al Viro and
231 Pekka Enberg.
3f2faef0
AA
232 - Stamp the transaction log ($UsnJrnl), aka user space journal, if it
233 is active on the volume and we are mounting read-write or remounting
234 from read-only to read-write.
9f993fe4
AA
235 - Fix a bug in address space operations error recovery code paths where
236 if the runlist was not mapped at all and a mapping error occured we
237 would leave the runlist locked on exit to the function so that the
238 next access to the same file would try to take the lock and deadlock.
ca8fd7a0
AA
239 - Detect the case when Windows has been suspended to disk on the volume
240 to be mounted and if this is the case do not allow (re)mounting
241 read-write. This is done by parsing hiberfil.sys if present.
3bd1f4a1
AA
242 - Fix several occurences of a bug where we would perform 'var & ~const'
243 with a 64-bit variable and a int, i.e. 32-bit, constant. This causes
244 the higher order 32-bits of the 64-bit variable to be zeroed. To fix
245 this cast the 'const' to the same 64-bit type as 'var'.
1d58b27b
AA
246 - Change the runlist terminator of the newly allocated cluster(s) to
247 LCN_ENOENT in ntfs_attr_make_non_resident(). Otherwise the runlist
248 code gets confused.
fa3be923
AA
249 - Add an extra parameter @last_vcn to ntfs_get_size_for_mapping_pairs()
250 and ntfs_mapping_pairs_build() to allow the runlist encoding to be
251 partial which is desirable when filling holes in sparse attributes.
252 Update all callers.
4757d7df
AA
253 - Change ntfs_map_runlist_nolock() to only decompress the mapping pairs
254 if the requested vcn is inside it. Otherwise we get into problems
255 when we try to map an out of bounds vcn because we then try to map
256 the already mapped runlist fragment which causes
257 ntfs_mapping_pairs_decompress() to fail and return error. Update
258 ntfs_attr_find_vcn_nolock() accordingly.
ba6d2377
AA
259 - Fix a nasty deadlock that appeared in recent kernels.
260 The situation: VFS inode X on a mounted ntfs volume is dirty. For
261 same inode X, the ntfs_inode is dirty and thus corresponding on-disk
262 inode, i.e. mft record, which is in a dirty PAGE_CACHE_PAGE belonging
263 to the table of inodes, i.e. $MFT, inode 0.
264 What happens:
265 Process 1: sys_sync()/umount()/whatever... calls
266 __sync_single_inode() for $MFT -> do_writepages() -> write_page for
267 the dirty page containing the on-disk inode X, the page is now locked
268 -> ntfs_write_mst_block() which clears PageUptodate() on the page to
269 prevent anyone else getting hold of it whilst it does the write out.
270 This is necessary as the on-disk inode needs "fixups" applied before
271 the write to disk which are removed again after the write and
272 PageUptodate is then set again. It then analyses the page looking
273 for dirty on-disk inodes and when it finds one it calls
274 ntfs_may_write_mft_record() to see if it is safe to write this
275 on-disk inode. This then calls ilookup5() to check if the
276 corresponding VFS inode is in icache(). This in turn calls ifind()
277 which waits on the inode lock via wait_on_inode whilst holding the
278 global inode_lock.
279 Process 2: pdflush results in a call to __sync_single_inode for the
280 same VFS inode X on the ntfs volume. This locks the inode (I_LOCK)
281 then calls write-inode -> ntfs_write_inode -> map_mft_record() ->
282 read_cache_page() for the page (in page cache of table of inodes
283 $MFT, inode 0) containing the on-disk inode. This page has
284 PageUptodate() clear because of Process 1 (see above) so
285 read_cache_page() blocks when it tries to take the page lock for the
286 page so it can call ntfs_read_page().
287 Thus Process 1 is holding the page lock on the page containing the
288 on-disk inode X and it is waiting on the inode X to be unlocked in
289 ifind() so it can write the page out and then unlock the page.
290 And Process 2 is holding the inode lock on inode X and is waiting for
291 the page to be unlocked so it can call ntfs_readpage() or discover
292 that Process 1 set PageUptodate() again and use the page.
293 Thus we have a deadlock due to ifind() waiting on the inode lock.
294 The solution: The fix is to use the newly introduced
295 ilookup5_nowait() which does not wait on the inode's lock and hence
296 avoids the deadlock. This is safe as we do not care about the VFS
297 inode and only use the fact that it is in the VFS inode cache and the
298 fact that the vfs and ntfs inodes are one struct in memory to find
299 the ntfs inode in memory if present. Also, the ntfs inode has its
300 own locking so it does not matter if the vfs inode is locked.
e74589ac 301 - Fix bug in mft record writing where we forgot to set the device in
481d0374 302 the buffers when mapping them after the VM had discarded them.
e74589ac 303 Thanks to Martin MOKREJÅ  for the bug report.
1da177e4
LT
304
3052.1.22 - Many bug and race fixes and error handling improvements.
306
307 - Improve error handling in fs/ntfs/inode.c::ntfs_truncate().
308 - Change fs/ntfs/inode.c::ntfs_truncate() to return an error code
309 instead of void and provide a helper ntfs_truncate_vfs() for the
310 vfs ->truncate method.
311 - Add a new ntfs inode flag NInoTruncateFailed() and modify
312 fs/ntfs/inode.c::ntfs_truncate() to set and clear it appropriately.
313 - Fix min_size and max_size definitions in ATTR_DEF structure in
314 fs/ntfs/layout.h to be signed.
315 - Add attribute definition handling helpers to fs/ntfs/attrib.[hc]:
316 ntfs_attr_size_bounds_check(), ntfs_attr_can_be_non_resident(), and
317 ntfs_attr_can_be_resident(), which in turn use the new private helper
318 ntfs_attr_find_in_attrdef().
319 - In fs/ntfs/aops.c::mark_ntfs_record_dirty(), take the
320 mapping->private_lock around the dirtying of the buffer heads
321 analagous to the way it is done in __set_page_dirty_buffers().
322 - Ensure the mft record size does not exceed the PAGE_CACHE_SIZE at
323 mount time as this cannot work with the current implementation.
324 - Check for location of attribute name and improve error handling in
325 general in fs/ntfs/inode.c::ntfs_read_locked_inode() and friends.
326 - In fs/ntfs/aops.c::ntfs_writepage(), if the page is fully outside
327 i_size, i.e. race with truncate, invalidate the buffers on the page
328 so that they become freeable and hence the page does not leak.
329 - Remove unused function fs/ntfs/runlist.c::ntfs_rl_merge(). (Adrian
330 Bunk)
331 - Fix stupid bug in fs/ntfs/attrib.c::ntfs_attr_find() that resulted in
332 a NULL pointer dereference in the error code path when a corrupt
333 attribute was found. (Thanks to Domen Puncer for the bug report.)
334 - Add MODULE_VERSION() to fs/ntfs/super.c.
335 - Make several functions and variables static. (Adrian Bunk)
336 - Modify fs/ntfs/aops.c::mark_ntfs_record_dirty() so it allocates
337 buffers for the page if they are not present and then marks the
338 buffers belonging to the ntfs record dirty. This causes the buffers
339 to become busy and hence they are safe from removal until the page
340 has been written out.
341 - Fix stupid bug in fs/ntfs/attrib.c::ntfs_external_attr_find() in the
342 error handling code path that resulted in a BUG() due to trying to
343 unmap an extent mft record when the mapping of it had failed and it
344 thus was not mapped. (Thanks to Ken MacFerrin for the bug report.)
345 - Drop the runlist lock after the vcn has been read in
346 fs/ntfs/lcnalloc.c::__ntfs_cluster_free().
347 - Rewrite handling of multi sector transfer errors. We now do not set
348 PageError() when such errors are detected in the async i/o handler
349 fs/ntfs/aops.c::ntfs_end_buffer_async_read(). All users of mst
350 protected attributes now check the magic of each ntfs record as they
351 use it and act appropriately. This has the effect of making errors
352 granular per ntfs record rather than per page which solves the case
353 where we cannot access any of the ntfs records in a page when a
354 single one of them had an mst error. (Thanks to Ken MacFerrin for
355 the bug report.)
356 - Fix error handling in fs/ntfs/quota.c::ntfs_mark_quotas_out_of_date()
357 where we failed to release i_sem on the $Quota/$Q attribute inode.
358 - Fix bug in handling of bad inodes in fs/ntfs/namei.c::ntfs_lookup().
359 - Add mapping of unmapped buffers to all remaining code paths, i.e.
360 fs/ntfs/aops.c::ntfs_write_mst_block(), mft.c::ntfs_sync_mft_mirror(),
361 and write_mft_record_nolock(). From now on we require that the
362 complete runlist for the mft mirror is always mapped into memory.
363 - Add creation of buffers to fs/ntfs/mft.c::ntfs_sync_mft_mirror().
364 - Improve error handling in fs/ntfs/aops.c::ntfs_{read,write}_block().
365 - Cleanup fs/ntfs/aops.c::ntfs_{read,write}page() since we know that a
366 resident attribute will be smaller than a page which makes the code
367 simpler. Also make the code more tolerant to concurrent ->truncate.
368
3692.1.21 - Fix some races and bugs, rewrite mft write code, add mft allocator.
370
371 - Implement extent mft record deallocation
372 fs/ntfs/mft.c::ntfs_extent_mft_record_free().
373 - Splitt runlist related functions off from attrib.[hc] to runlist.[hc].
374 - Add vol->mft_data_pos and initialize it at mount time.
375 - Rename init_runlist() to ntfs_init_runlist(), ntfs_vcn_to_lcn() to
376 ntfs_rl_vcn_to_lcn(), decompress_mapping_pairs() to
377 ntfs_mapping_pairs_decompress(), ntfs_merge_runlists() to
378 ntfs_runlists_merge() and adapt all callers.
379 - Add fs/ntfs/runlist.[hc]::ntfs_get_nr_significant_bytes(),
380 ntfs_get_size_for_mapping_pairs(), ntfs_write_significant_bytes(),
381 and ntfs_mapping_pairs_build(), adapted from libntfs.
382 - Make fs/ntfs/lcnalloc.c::ntfs_cluster_free_from_rl_nolock() not
383 static and add a declaration for it to lcnalloc.h.
384 - Add fs/ntfs/lcnalloc.h::ntfs_cluster_free_from_rl() which is a static
385 inline wrapper for ntfs_cluster_free_from_rl_nolock() which takes the
386 cluster bitmap lock for the duration of the call.
387 - Add fs/ntfs/attrib.[hc]::ntfs_attr_record_resize().
388 - Implement the equivalent of memset() for an ntfs attribute in
389 fs/ntfs/attrib.[hc]::ntfs_attr_set() and switch
390 fs/ntfs/logfile.c::ntfs_empty_logfile() to using it.
391 - Remove unnecessary casts from LCN_* constants.
392 - Implement fs/ntfs/runlist.c::ntfs_rl_truncate_nolock().
393 - Add MFT_RECORD_OLD as a copy of MFT_RECORD in fs/ntfs/layout.h and
394 change MFT_RECORD to contain the NTFS 3.1+ specific fields.
395 - Add a helper function fs/ntfs/aops.c::mark_ntfs_record_dirty() which
396 marks all buffers belonging to an ntfs record dirty, followed by
397 marking the page the ntfs record is in dirty and also marking the vfs
398 inode containing the ntfs record dirty (I_DIRTY_PAGES).
399 - Switch fs/ntfs/index.h::ntfs_index_entry_mark_dirty() to using the
400 new helper fs/ntfs/aops.c::mark_ntfs_record_dirty() and remove the no
401 longer needed fs/ntfs/index.[hc]::__ntfs_index_entry_mark_dirty().
402 - Move ntfs_{un,}map_page() from ntfs.h to aops.h and fix resulting
403 include errors.
404 - Move the typedefs for runlist_element and runlist from types.h to
405 runlist.h and fix resulting include errors.
406 - Remove unused {__,}format_mft_record() from fs/ntfs/mft.c.
407 - Modify fs/ntfs/mft.c::__mark_mft_record_dirty() to use the helper
408 mark_ntfs_record_dirty() which also changes the behaviour in that we
409 now set the buffers belonging to the mft record dirty as well as the
410 page itself.
411 - Update fs/ntfs/mft.c::write_mft_record_nolock() and sync_mft_mirror()
412 to cope with the fact that there now are dirty buffers in mft pages.
413 - Update fs/ntfs/inode.c::ntfs_write_inode() to also use the helper
414 mark_ntfs_record_dirty() and thus to set the buffers belonging to the
415 mft record dirty as well as the page itself.
416 - Fix compiler warnings on x86-64 in fs/ntfs/dir.c. (Randy Dunlap,
417 slightly modified by me)
418 - Add fs/ntfs/mft.c::try_map_mft_record() which fails with -EALREADY if
419 the mft record is already locked and otherwise behaves the same way
420 as fs/ntfs/mft.c::map_mft_record().
421 - Modify fs/ntfs/mft.c::write_mft_record_nolock() so that it only
422 writes the mft record if the buffers belonging to it are dirty.
423 Otherwise we assume that it was written out by other means already.
424 - Attempting to write outside initialized size is _not_ a bug so remove
425 the bug check from fs/ntfs/aops.c::ntfs_write_mst_block(). It is in
426 fact required to write outside initialized size when preparing to
427 extend the initialized size.
428 - Map the page instead of using page_address() before writing to it in
429 fs/ntfs/aops.c::ntfs_mft_writepage().
430 - Provide exclusion between opening an inode / mapping an mft record
431 and accessing the mft record in fs/ntfs/mft.c::ntfs_mft_writepage()
432 by setting the page not uptodate throughout ntfs_mft_writepage().
433 - Clear the page uptodate flag in fs/ntfs/aops.c::ntfs_write_mst_block()
434 to ensure noone can see the page whilst the mst fixups are applied.
435 - Add the helper fs/ntfs/mft.c::ntfs_may_write_mft_record() which
436 checks if an mft record may be written out safely obtaining any
437 necessary locks in the process. This is used by
438 fs/ntfs/aops.c::ntfs_write_mst_block().
439 - Modify fs/ntfs/aops.c::ntfs_write_mst_block() to also work for
440 writing mft records and improve its error handling in the process.
441 Now if any of the records in the page fail to be written out, all
442 other records will be written out instead of aborting completely.
443 - Remove ntfs_mft_aops and update all users to use ntfs_mst_aops.
444 - Modify fs/ntfs/inode.c::ntfs_read_locked_inode() to set the
445 ntfs_mst_aops for all inodes which are NInoMstProtected() and
446 ntfs_aops for all other inodes.
447 - Rename fs/ntfs/mft.c::sync_mft_mirror{,_umount}() to
448 ntfs_sync_mft_mirror{,_umount}() and change their parameters so they
449 no longer require an ntfs inode to be present. Update all callers.
450 - Cleanup the error handling in fs/ntfs/mft.c::ntfs_sync_mft_mirror().
451 - Clear the page uptodate flag in fs/ntfs/mft.c::ntfs_sync_mft_mirror()
452 to ensure noone can see the page whilst the mst fixups are applied.
453 - Remove the no longer needed fs/ntfs/mft.c::ntfs_mft_writepage() and
454 fs/ntfs/mft.c::try_map_mft_record().
455 - Fix callers of fs/ntfs/aops.c::mark_ntfs_record_dirty() to call it
456 with the ntfs inode which contains the page rather than the ntfs
457 inode the mft record of which is in the page.
458 - Fix race condition in fs/ntfs/inode.c::ntfs_put_inode() by moving the
459 index inode bitmap inode release code from there to
460 fs/ntfs/inode.c::ntfs_clear_big_inode(). (Thanks to Christoph
461 Hellwig for spotting this.)
462 - Fix race condition in fs/ntfs/inode.c::ntfs_put_inode() by taking the
463 inode semaphore around the code that sets ni->itype.index.bmp_ino to
464 NULL and reorganize the code to optimize it a bit. (Thanks to
465 Christoph Hellwig for spotting this.)
466 - Modify fs/ntfs/aops.c::mark_ntfs_record_dirty() to no longer take the
467 ntfs inode as a parameter as this is confusing and misleading and the
468 needed ntfs inode is available via NTFS_I(page->mapping->host).
469 Adapt all callers to this change.
470 - Modify fs/ntfs/mft.c::write_mft_record_nolock() and
471 fs/ntfs/aops.c::ntfs_write_mst_block() to only check the dirty state
472 of the first buffer in a record and to take this as the ntfs record
473 dirty state. We cannot look at the dirty state for subsequent
474 buffers because we might be racing with
475 fs/ntfs/aops.c::mark_ntfs_record_dirty().
476 - Move the static inline ntfs_init_big_inode() from fs/ntfs/inode.c to
477 inode.h and make fs/ntfs/inode.c::__ntfs_init_inode() non-static and
478 add a declaration for it to inode.h. Fix some compilation issues
479 that resulted due to #includes and header file interdependencies.
480 - Simplify setup of i_mode in fs/ntfs/inode.c::ntfs_read_locked_inode().
481 - Add helpers fs/ntfs/layout.h::MK_MREF() and MK_LE_MREF().
482 - Modify fs/ntfs/mft.c::map_extent_mft_record() to only verify the mft
483 record sequence number if it is specified (i.e. not zero).
484 - Add fs/ntfs/mft.[hc]::ntfs_mft_record_alloc() and various helper
485 functions used by it.
486 - Update Documentation/filesystems/ntfs.txt with instructions on how to
487 use the Device-Mapper driver with NTFS ftdisk/LDM raid. This removes
488 the linear raid problem with the Software RAID / MD driver when one
489 or more of the devices has an odd number of sectors.
490
4912.1.20 - Fix two stupid bugs introduced in 2.1.18 release.
492
493 - Fix stupid bug in fs/ntfs/attrib.c::ntfs_attr_reinit_search_ctx()
494 where we did not clear ctx->al_entry but it was still set due to
495 changes in ntfs_attr_lookup() and ntfs_external_attr_find() in
496 particular.
497 - Fix another stupid bug in fs/ntfs/attrib.c::ntfs_external_attr_find()
498 where we forgot to unmap the extent mft record when we had finished
499 enumerating an attribute which caused a bug check to trigger when the
500 VFS calls ->clear_inode.
501
5022.1.19 - Many cleanups, improvements, and a minor bug fix.
503
504 - Update ->setattr (fs/ntfs/inode.c::ntfs_setattr()) to refuse to
505 change the uid, gid, and mode of an inode as we do not support NTFS
506 ACLs yet.
507 - Remove BKL use from ntfs_setattr() syncing up with the rest of the
508 kernel.
509 - Get rid of the ugly transparent union in fs/ntfs/dir.c::ntfs_readdir()
510 and ntfs_filldir() as per suggestion from Al Viro.
511 - Change '\0' and L'\0' to simply 0 as per advice from Linus Torvalds.
512 - Update ->truncate (fs/ntfs/inode.c::ntfs_truncate()) to check if the
513 inode size has changed and to only output an error if so.
514 - Rename fs/ntfs/attrib.h::attribute_value_length() to ntfs_attr_size().
515 - Add le{16,32,64} as well as sle{16,32,64} data types to
516 fs/ntfs/types.h.
517 - Change ntfschar to be le16 instead of u16 in fs/ntfs/types.h.
518 - Add le versions of VCN, LCN, and LSN called leVCN, leLCN, and leLSN,
519 respectively, to fs/ntfs/types.h.
520 - Update endianness conversion macros in fs/ntfs/endian.h to use the
521 new types as appropriate.
522 - Do proper type casting when using sle64_to_cpup() in fs/ntfs/dir.c
523 and index.c.
524 - Add leMFT_REF data type to fs/ntfs/layout.h.
525 - Update all NTFS header files with the new little endian data types.
526 Affected files are fs/ntfs/layout.h, logfile.h, and time.h.
527 - Do proper type casting when using ntfs_is_*_recordp() in
528 fs/ntfs/logfile.c, mft.c, and super.c.
529 - Fix all the sparse bitwise warnings. Had to change all the typedef
530 enums storing little endian values to simple enums plus a typedef for
531 the datatype to make sparse happy.
532 - Fix a bug found by the new sparse bitwise warnings where the default
533 upcase table was defined as a pointer to wchar_t rather than ntfschar
534 in fs/ntfs/ntfs.h and super.c.
535 - Change {const_,}cpu_to_le{16,32}(0) to just 0 as suggested by Al Viro.
536
5372.1.18 - Fix scheduling latencies at mount time as well as an endianness bug.
538
539 - Remove vol->nr_mft_records as it was pretty meaningless and optimize
540 the calculation of total/free inodes as used by statfs().
541 - Fix scheduling latencies in ntfs_fill_super() by dropping the BKL
542 because the code itself is using the ntfs_lock semaphore which
543 provides safe locking. (Ingo Molnar)
544 - Fix a potential bug in fs/ntfs/mft.c::map_extent_mft_record() that
545 could occur in the future for when we start closing/freeing extent
546 inodes if we don't set base_ni->ext.extent_ntfs_inos to NULL after
547 we free it.
548 - Rename {find,lookup}_attr() to ntfs_attr_{find,lookup}() as well as
549 find_external_attr() to ntfs_external_attr_find() to cleanup the
550 namespace a bit and to be more consistent with libntfs.
551 - Rename {{re,}init,get,put}_attr_search_ctx() to
552 ntfs_attr_{{re,}init,get,put}_search_ctx() as well as the type
553 attr_search_context to ntfs_attr_search_ctx.
554 - Force use of ntfs_attr_find() in ntfs_attr_lookup() when searching
555 for the attribute list attribute itself.
556 - Fix endianness bug in ntfs_external_attr_find().
557 - Change ntfs_{external_,}attr_find() to return 0 on success, -ENOENT
558 if the attribute is not found, and -EIO on real error. In the case
559 of -ENOENT, the search context is updated to describe the attribute
560 before which the attribute being searched for would need to be
561 inserted if such an action were to be desired and in the case of
562 ntfs_external_attr_find() the search context is also updated to
563 indicate the attribute list entry before which the attribute list
564 entry of the attribute being searched for would need to be inserted
565 if such an action were to be desired. Also make ntfs_find_attr()
566 static and remove its prototype from attrib.h as it is not used
567 anywhere other than attrib.c. Update ntfs_attr_lookup() and all
568 callers of ntfs_{external,}attr_{find,lookup}() for the new return
569 values.
570 - Minor cleanup of fs/ntfs/inode.c::ntfs_init_locked_inode().
571
5722.1.17 - Fix bugs in mount time error code paths and other updates.
573
574 - Implement bitmap modification code (fs/ntfs/bitmap.[hc]). This
575 includes functions to set/clear a single bit or a run of bits.
576 - Add fs/ntfs/attrib.[hc]::ntfs_find_vcn() which returns the locked
577 runlist element containing a particular vcn. It also takes care of
578 mapping any needed runlist fragments.
579 - Implement cluster (de-)allocation code (fs/ntfs/lcnalloc.[hc]).
580 - Load attribute definition table from $AttrDef at mount time.
581 - Fix bugs in mount time error code paths involving (de)allocation of
582 the default and volume upcase tables.
583 - Remove ntfs_nr_mounts as it is no longer used.
584
5852.1.16 - Implement access time updates, file sync, async io, and read/writev.
586
587 - Add support for readv/writev and aio_read/aio_write (fs/ntfs/file.c).
588 This is done by setting the appropriate file operations pointers to
589 the generic helper functions provided by mm/filemap.c.
590 - Implement fsync, fdatasync, and msync both for files (fs/ntfs/file.c)
591 and directories (fs/ntfs/dir.c).
592 - Add support for {a,m,c}time updates to inode.c::ntfs_write_inode().
593 Note, except for the root directory and any other system files opened
594 by the user, the system files will not have their access times
595 updated as they are only accessed at the inode level an hence the
596 file level functions which cause the times to be updated are never
597 invoked.
598
5992.1.15 - Invalidate quotas when (re)mounting read-write.
600
601 - Add new element itype.index.collation_rule to the ntfs inode
602 structure and set it appropriately in ntfs_read_locked_inode().
603 - Implement a new inode type "index" to allow efficient access to the
604 indices found in various system files and adapt inode handling
605 accordingly (fs/ntfs/inode.[hc]). An index inode is essentially an
606 attribute inode (NInoAttr() is true) with an attribute type of
607 AT_INDEX_ALLOCATION. As such, it is no longer allowed to call
608 ntfs_attr_iget() with an attribute type of AT_INDEX_ALLOCATION as
609 there would be no way to distinguish between normal attribute inodes
610 and index inodes. The function to obtain an index inode is
611 ntfs_index_iget() and it uses the helper function
612 ntfs_read_locked_index_inode(). Note, we do not overload
613 ntfs_attr_iget() as indices consist of multiple attributes so using
614 ntfs_attr_iget() to obtain an index inode would be confusing.
615 - Ensure that there is no overflow when doing page->index <<
616 PAGE_CACHE_SHIFT by casting page->index to s64 in fs/ntfs/aops.c.
617 - Use atomic kmap instead of kmap() in fs/ntfs/aops.c::ntfs_read_page()
618 and ntfs_read_block().
619 - Use case sensitive attribute lookups instead of case insensitive ones.
620 - Lock all page cache pages belonging to mst protected attributes while
621 accessing them to ensure we never see corrupt data while the page is
622 under writeout.
623 - Add framework for generic ntfs collation (fs/ntfs/collation.[hc]).
624 We have ntfs_is_collation_rule_supported() to check if the collation
625 rule you want to use is supported and ntfs_collation() which actually
626 collates two data items. We currently only support COLLATION_BINARY
627 and COLLATION_NTOFS_ULONG but support for other collation rules will
628 be added as the need arises.
629 - Add a new type, ntfs_index_context, to allow retrieval of an index
630 entry using the corresponding index key. To get an index context,
631 use ntfs_index_ctx_get() and to release it, use ntfs_index_ctx_put().
632 This also adds a new slab cache for the index contexts. To lookup a
633 key in an index inode, use ntfs_index_lookup(). After modifying an
634 index entry, call ntfs_index_entry_flush_dcache_page() followed by
635 ntfs_index_entry_mark_dirty() to ensure the changes are written out
636 to disk. For details see fs/ntfs/index.[hc]. Note, at present, if
637 an index entry is in the index allocation attribute rather than the
638 index root attribute it will not be written out (you will get a
639 warning message about discarded changes instead).
640 - Load the quota file ($Quota) and check if quota tracking is enabled
641 and if so, mark the quotas out of date. This causes windows to
642 rescan the volume on boot and update all quota entries.
643 - Add a set_page_dirty address space operation for ntfs_m[fs]t_aops.
644 It is simply set to __set_page_dirty_nobuffers() to make sure that
645 running set_page_dirty() on a page containing mft/ntfs records will
646 not affect the dirty state of the page buffers.
647 - Add fs/ntfs/index.c::__ntfs_index_entry_mark_dirty() which sets all
648 buffers that are inside the ntfs record in the page dirty after which
649 it sets the page dirty. This allows ->writepage to only write the
650 dirty index records rather than having to write all the records in
651 the page. Modify fs/ntfs/index.h::ntfs_index_entry_mark_dirty() to
652 use this rather than __set_page_dirty_nobuffers().
653 - Implement fs/ntfs/aops.c::ntfs_write_mst_block() which enables the
654 writing of page cache pages belonging to mst protected attributes
655 like the index allocation attribute in directory indices and other
656 indices like $Quota/$Q, etc. This means that the quota is now marked
657 out of date on all volumes rather than only on ones where the quota
658 defaults entry is in the index root attribute of the $Quota/$Q index.
659
6602.1.14 - Fix an NFSd caused deadlock reported by several users.
661
662 - Modify fs/ntfs/ntfs_readdir() to copy the index root attribute value
663 to a buffer so that we can put the search context and unmap the mft
664 record before calling the filldir() callback. We need to do this
665 because of NFSd which calls ->lookup() from its filldir callback()
666 and this causes NTFS to deadlock as ntfs_lookup() maps the mft record
667 of the directory and since ntfs_readdir() has got it mapped already
668 ntfs_lookup() deadlocks.
669
6702.1.13 - Enable overwriting of resident files and housekeeping of system files.
671
672 - Implement writing of mft records (fs/ntfs/mft.[hc]), which includes
673 keeping the mft mirror in sync with the mft when mirrored mft records
674 are written. The functions are write_mft_record{,_nolock}(). The
675 implementation is quite rudimentary for now with lots of things not
676 implemented yet but I am not sure any of them can actually occur so
677 I will wait for people to hit each one and only then implement it.
678 - Commit open system inodes at umount time. This should make it
679 virtually impossible for sync_mft_mirror_umount() to ever be needed.
680 - Implement ->write_inode (fs/ntfs/inode.c::ntfs_write_inode()) for the
681 ntfs super operations. This gives us inode writing via the VFS inode
682 dirty code paths. Note: Access time updates are not implemented yet.
683 - Implement fs/ntfs/mft.[hc]::{,__}mark_mft_record_dirty() and make
684 fs/ntfs/aops.c::ntfs_writepage() and ntfs_commit_write() use it, thus
685 finally enabling resident file overwrite! (-8 This also includes a
686 placeholder for ->writepage (ntfs_mft_writepage()), which for now
687 just redirties the page and returns. Also, at umount time, we for
688 now throw away all mft data page cache pages after the last call to
689 ntfs_commit_inode() in the hope that all inodes will have been
690 written out by then and hence no dirty (meta)data will be lost. We
691 also check for this case and emit an error message telling the user
692 to run chkdsk.
693 - Use set_page_writeback() and end_page_writeback() in the resident
694 attribute code path of fs/ntfs/aops.c::ntfs_writepage() otherwise
695 the radix-tree tag PAGECACHE_TAG_DIRTY remains set even though the
696 page is clean.
697 - Implement ntfs_mft_writepage() so it now checks if any of the mft
698 records in the page are dirty and if so redirties the page and
699 returns. Otherwise it just returns (after doing set_page_writeback(),
700 unlock_page(), end_page_writeback() or the radix-tree tag
701 PAGECACHE_TAG_DIRTY remains set even though the page is clean), thus
702 alowing the VM to do with the page as it pleases. Also, at umount
703 time, now only throw away dirty mft (meta)data pages if dirty inodes
704 are present and ask the user to email us if they see this happening.
705 - Add functions ntfs_{clear,set}_volume_flags(), to modify the volume
706 information flags (fs/ntfs/super.c).
707 - Mark the volume dirty when (re)mounting read-write and mark it clean
708 when unmounting or remounting read-only. If any volume errors are
709 found, the volume is left marked dirty to force chkdsk to run.
710 - Add code to set the NT4 compatibility flag when (re)mounting
711 read-write for newer NTFS versions but leave it commented out for now
712 since we do not make any modifications that are NTFS 1.2 specific yet
713 and since setting this flag breaks Captive-NTFS which is not nice.
714 This code must be enabled once we start writing NTFS 1.2 specific
715 changes otherwise Windows NTFS driver might crash / cause corruption.
716
7172.1.12 - Fix the second fix to the decompression engine and some cleanups.
718
719 - Add a new address space operations struct, ntfs_mst_aops, for mst
720 protected attributes. This is because the default ntfs_aops do not
721 make sense with mst protected data and were they to write anything to
722 such an attribute they would cause data corruption so we provide
723 ntfs_mst_aops which does not have any write related operations set.
724 - Cleanup dirty ntfs inode handling (fs/ntfs/inode.[hc]) which also
725 includes an adapted ntfs_commit_inode() and an implementation of
726 ntfs_write_inode() which for now just cleans dirty inodes without
727 writing them (it does emit a warning that this is happening).
728 - Undo the second decompression engine fix (see 2.1.9 release ChangeLog
729 entry) as it was only fixing a theoretical bug but at the same time
730 it badly broke the handling of sparse and uncompressed compression
731 blocks.
732
7332.1.11 - Driver internal cleanups.
734
735 - Only build logfile.o if building the driver with read-write support.
736 - Really final white space cleanups.
737 - Use generic_ffs() instead of ffs() in logfile.c which allows the
738 log_page_size variable to be optimized by gcc into a constant.
739 - Rename uchar_t to ntfschar everywhere as uchar_t is unsigned 1-byte
740 char as defined by POSIX and as found on some systems.
741
7422.1.10 - Force read-only (re)mounting of volumes with unsupported volume flags.
743
744 - Finish off the white space cleanups (remove trailing spaces, etc).
745 - Clean up ntfs_fill_super() and ntfs_read_inode_mount() by removing
746 the kludges around the first iget(). Instead of (re)setting ->s_op
747 we have the $MFT inode set up by explicit new_inode() / set ->i_ino /
748 insert_inode_hash() / call ntfs_read_inode_mount() directly. This
749 kills the need for second super_operations and allows to return error
750 from ntfs_read_inode_mount() without resorting to ugly "poisoning"
751 tricks. (Al Viro)
752 - Force read-only (re)mounting if any of the following bits are set in
753 the volume information flags:
754 VOLUME_IS_DIRTY, VOLUME_RESIZE_LOG_FILE,
755 VOLUME_UPGRADE_ON_MOUNT, VOLUME_DELETE_USN_UNDERWAY,
756 VOLUME_REPAIR_OBJECT_ID, VOLUME_MODIFIED_BY_CHKDSK
757 To make this easier we define VOLUME_MUST_MOUNT_RO_MASK with all the
758 above bits set so the test is made easy.
759
7602.1.9 - Fix two bugs in decompression engine.
761
762 - Fix a bug where we would not always detect that we have reached the
763 end of a compression block because we were ending at minus one byte
764 which is effectively the same as being at the end. The fix is to
765 check whether the uncompressed buffer has been fully filled and if so
766 we assume we have reached the end of the compression block. A big
767 thank you to Marcin Gibuła for the bug report, the assistance in
768 tracking down the bug and testing the fix.
769 - Fix a possible bug where when a compressed read is truncated to the
770 end of the file, the offset inside the last page was not truncated.
771
7722.1.8 - Handle $MFT mirror and $LogFile, improve time handling, and cleanups.
773
774 - Use get_bh() instead of manual atomic_inc() in fs/ntfs/compress.c.
775 - Modify fs/ntfs/time.c::ntfs2utc(), get_current_ntfs_time(), and
776 utc2ntfs() to work with struct timespec instead of time_t on the
777 Linux UTC time side thus preserving the full precision of the NTFS
778 time and only loosing up to 99 nano-seconds in the Linux UTC time.
779 - Move fs/ntfs/time.c to fs/ntfs/time.h and make the time functions
780 static inline.
781 - Remove unused ntfs_dirty_inode().
782 - Cleanup super operations declaration in fs/ntfs/super.c.
783 - Wrap flush_dcache_mft_record_page() in #ifdef NTFS_RW.
784 - Add NInoTestSetFoo() and NInoTestClearFoo() macro magic to
785 fs/ntfs/inode.h and use it to declare NInoTest{Set,Clear}Dirty.
786 - Move typedefs for ntfs_attr and test_t from fs/ntfs/inode.c to
787 fs/ntfs/inode.h so they can be used elsewhere.
788 - Determine the mft mirror size as the number of mirrored mft records
789 and store it in ntfs_volume->mftmirr_size (fs/ntfs/super.c).
790 - Load the mft mirror at mount time and compare the mft records stored
791 in it to the ones in the mft. Force a read-only mount if the two do
792 not match (fs/ntfs/super.c).
793 - Fix type casting related warnings on 64-bit architectures. Thanks
794 to Meelis Roos for reporting them.
795 - Move %L to %ll as %L is floating point and %ll is integer which is
796 what we want.
797 - Read the journal ($LogFile) and determine if the volume has been
798 shutdown cleanly and force a read-only mount if not (fs/ntfs/super.c
799 and fs/ntfs/logfile.c). This is a little bit of a crude check in
800 that we only look at the restart areas and not at the actual log
801 records so that there will be a very small number of cases where we
802 think that a volume is dirty when in fact it is clean. This should
803 only affect volumes that have not been shutdown cleanly and did not
804 have any pending, non-check-pointed i/o.
805 - If the $LogFile indicates a clean shutdown and a read-write (re)mount
806 is requested, empty $LogFile by overwriting it with 0xff bytes to
807 ensure that Windows cannot cause data corruption by replaying a stale
808 journal after Linux has written to the volume.
809
8102.1.7 - Enable NFS exporting of mounted NTFS volumes.
811
812 - Set i_generation in the VFS inode from the seq_no of the NTFS inode.
813 - Make ntfs_lookup() NFS export safe, i.e. use d_splice_alias(), etc.
814 - Implement ->get_dentry() in fs/ntfs/namei.c::ntfs_get_dentry() as the
815 default doesn't allow inode number 0 which is a valid inode on NTFS
816 and even if it did allow that it uses iget() instead of ntfs_iget()
817 which makes it useless for us.
818 - Implement ->get_parent() in fs/ntfs/namei.c::ntfs_get_parent() as the
819 default just returns -EACCES which is not very useful.
820 - Define export operations (->s_export_op) for NTFS (ntfs_export_ops)
821 and set them up in the super block at mount time (super.c) this
822 allows mounted NTFS volumes to be exported via NFS.
823 - Add missing return -EOPNOTSUPP; in
824 fs/ntfs/aops.c::ntfs_commit_nonresident_write().
825 - Enforce no atime and no dir atime updates at mount/remount time as
826 they are not implemented yet anyway.
827 - Move a few assignments in fs/ntfs/attrib.c::load_attribute_list() to
828 after a NULL check. Thanks to Dave Jones for pointing this out.
829
8302.1.6 - Fix minor bug in handling of compressed directories.
831
832 - Fix bug in handling of compressed directories. A compressed
833 directory is not really compressed so when we set the ->i_blocks
834 field of a compressed directory inode we were setting it from the
835 non-existing field ni->itype.compressed.size which gave random
836 results... For directories we now always use ni->allocated_size.
837
8382.1.5 - Fix minor bug in attribute list attribute handling.
839
840 - Fix bug in attribute list handling. Actually it is not as much a bug
841 as too much protection in that we were not allowing attribute lists
842 which waste space on disk while Windows XP clearly allows it and in
843 fact creates such attribute lists so our driver was failing.
844 - Update NTFS documentation ready for 2.6 kernel release.
845
8462.1.4 - Reduce compiler requirements.
847
848 - Remove all uses of unnamed structs and unions in the driver to make
849 old and newer gcc versions happy. Makes it a bit uglier IMO but at
850 least people will stop hassling me about it.
851
8522.1.3 - Important bug fixes in corner cases.
853
854 - super.c::parse_ntfs_boot_sector(): Correct the check for 64-bit
855 clusters. (Philipp Thomas)
856 - attrib.c::load_attribute_list(): Fix bug when initialized_size is a
857 multiple of the block_size but not the cluster size. (Szabolcs
858 Szakacsits <szaka@sienet.hu>)
859
8602.1.2 - Important bug fixes aleviating the hangs in statfs.
861
862 - Fix buggy free cluster and free inode determination logic.
863
8642.1.1 - Minor updates.
865
866 - Add handling for initialized_size != data_size in compressed files.
867 - Reduce function local stack usage from 0x3d4 bytes to just noise in
868 fs/ntfs/upcase.c. (Randy Dunlap <rddunlap@osdl.ord>)
869 - Remove compiler warnings for newer gcc.
870 - Pages are no longer kmapped by mm/filemap.c::generic_file_write()
871 around calls to ->{prepare,commit}_write. Adapt NTFS appropriately
872 in fs/ntfs/aops.c::ntfs_prepare_nonresident_write() by using
873 kmap_atomic(KM_USER0).
874
8752.1.0 - First steps towards write support: implement file overwrite.
876
877 - Add configuration option for developmental write support with an
878 appropriately scary configuration help text.
879 - Initial implementation of fs/ntfs/aops.c::ntfs_writepage() and its
880 helper fs/ntfs/aops.c::ntfs_write_block(). This enables mmap(2) based
881 overwriting of existing files on ntfs. Note: Resident files are
882 only written into memory, and not written out to disk at present, so
883 avoid writing to files smaller than about 1kiB.
884 - Initial implementation of fs/ntfs/aops.c::ntfs_prepare_write(), its
885 helper fs/ntfs/aops.c::ntfs_prepare_nonresident_write() and their
886 counterparts, fs/ntfs/aops.c::ntfs_commit_write(), and
887 fs/ntfs/aops.c::ntfs_commit_nonresident_write(), respectively. Also,
888 add generic_file_write() to the ntfs file operations (fs/ntfs/file.c).
889 This enables write(2) based overwriting of existing files on ntfs.
890 Note: As with mmap(2) based overwriting, resident files are only
891 written into memory, and not written out to disk at present, so avoid
892 writing to files smaller than about 1kiB.
893 - Implement ->truncate (fs/ntfs/inode.c::ntfs_truncate()) and
894 ->setattr() (fs/ntfs/inode.c::ntfs_setattr()) inode operations for
895 files with the purpose of intercepting and aborting all i_size
896 changes which we do not support yet. ntfs_truncate() actually only
897 emits a warning message but AFAICS our interception of i_size changes
898 elsewhere means ntfs_truncate() never gets called for i_size changes.
899 It is only called from generic_file_write() when we fail in
900 ntfs_prepare_{,nonresident_}write() in order to discard any
901 instantiated buffers beyond i_size. Thus i_size is not actually
902 changed so our warning message is enough. Unfortunately it is not
903 possible to easily determine if i_size is being changed or not hence
904 we just emit an appropriately worded error message.
905
9062.0.25 - Small bug fixes and cleanups.
907
908 - Unlock the page in an out of memory error code path in
909 fs/ntfs/aops.c::ntfs_read_block().
910 - If fs/ntfs/aops.c::ntfs_read_page() is called on an uptodate page,
911 just unlock the page and return. (This can happen due to ->writepage
912 clearing PageUptodate() during write out of MstProtected()
913 attributes.
914 - Remove leaked write code again.
915
9162.0.24 - Cleanups.
917
918 - Treat BUG_ON() as ASSERT() not VERIFY(), i.e. do not use side effects
919 inside BUG_ON(). (Adam J. Richter)
920 - Split logical OR expressions inside BUG_ON() into individual BUG_ON()
921 calls for improved debugging. (Adam J. Richter)
922 - Add errors flag to the ntfs volume state, accessed via
923 NVol{,Set,Clear}Errors(vol).
924 - Do not allow read-write remounts of read-only volumes with errors.
925 - Clarify comment for ntfs file operation sendfile which was added by
926 Christoph Hellwig a while ago (just using generic_file_sendfile())
927 to say that ntfs ->sendfile is only used for the case where the
928 source data is on the ntfs partition and the destination is
929 somewhere else, i.e. nothing we need to concern ourselves with.
930 - Add generic_file_write() as our ntfs file write operation.
931
9322.0.23 - Major bug fixes (races, deadlocks, non-i386 architectures).
933
934 - Massive internal locking changes to mft record locking. Fixes lock
935 recursion and replaces the mrec_lock read/write semaphore with a
936 mutex. Also removes the now superfluous mft_count. This fixes several
937 race conditions and deadlocks, especially in the future write code.
938 - Fix ntfs over loopback for compressed files by adding an
939 optimization barrier. (gcc was screwing up otherwise ?)
940 - Miscellaneous cleanups all over the code and a fix or two in error
941 handling code paths.
942 Thanks go to Christoph Hellwig for pointing out the following two:
943 - Remove now unused function fs/ntfs/malloc.h::vmalloc_nofs().
944 - Fix ntfs_free() for ia64 and parisc by checking for VMALLOC_END, too.
945
9462.0.22 - Cleanups, mainly to ntfs_readdir(), and use C99 initializers.
947
948 - Change fs/ntfs/dir.c::ntfs_reddir() to only read/write ->f_pos once
949 at entry/exit respectively.
950 - Use C99 initializers for structures.
951 - Remove unused variable blocks from fs/ntfs/aops.c::ntfs_read_block().
952
9532.0.21 - Check for, and refuse to work with too large files/directories/volumes.
954
955 - Limit volume size at mount time to 2TiB on architectures where
956 unsigned long is 32-bits (fs/ntfs/super.c::parse_ntfs_boot_sector()).
957 This is the most we can do without overflowing the 32-bit limit of
958 the block device size imposed on us by sb_bread() and sb_getblk()
959 for the time being.
960 - Limit file/directory size at open() time to 16TiB on architectures
961 where unsigned long is 32-bits (fs/ntfs/file.c::ntfs_file_open() and
962 fs/ntfs/dir.c::ntfs_dir_open()). This is the most we can do without
963 overflowing the page cache page index.
964
9652.0.20 - Support non-resident directory index bitmaps, fix page leak in readdir.
966
967 - Move the directory index bitmap to use an attribute inode instead of
968 having special fields for it inside the ntfs inode structure. This
969 means that the index bitmaps now use the page cache for i/o, too,
970 and also as a side effect we get support for non-resident index
971 bitmaps for free.
972 - Simplify/cleanup error handling in fs/ntfs/dir.c::ntfs_readdir() and
973 fix a page leak that manifested itself in some cases.
974 - Add fs/ntfs/inode.c::ntfs_put_inode(), which we need to release the
975 index bitmap inode on the final iput().
976
9772.0.19 - Fix race condition, improvements, and optimizations in i/o interface.
978
979 - Apply block optimization added to fs/ntfs/aops.c::ntfs_read_block()
980 to fs/ntfs/compress.c::ntfs_file_read_compressed_block() as well.
981 - Drop the "file" from ntfs_file_read_compressed_block().
982 - Rename fs/ntfs/aops.c::ntfs_enb_buffer_read_async() to
983 ntfs_end_buffer_async_read() (more like the fs/buffer.c counterpart).
984 - Update ntfs_end_buffer_async_read() with the improved logic from
985 its updated counterpart fs/buffer.c::end_buffer_async_read(). Apply
986 further logic improvements to better determine when we set PageError.
987 - Update submission of buffers in fs/ntfs/aops.c::ntfs_read_block() to
988 check for the buffers being uptodate first in line with the updated
989 fs/buffer.c::block_read_full_page(). This plugs a small race
990 condition.
991
9922.0.18 - Fix race condition in reading of compressed files.
993
994 - There was a narrow window between checking a buffer head for being
995 uptodate and locking it in ntfs_file_read_compressed_block(). We now
996 lock the buffer and then check whether it is uptodate or not.
997
9982.0.17 - Cleanups and optimizations - shrinking the ToDo list.
999
1000 - Modify fs/ntfs/inode.c::ntfs_read_locked_inode() to return an error
1001 code and update callers, i.e. ntfs_iget(), to pass that error code
1002 up instead of just using -EIO.
1003 - Modifications to super.c to ensure that both mount and remount
1004 cannot set any write related options when the driver is compiled
1005 read-only.
1006 - Optimize block resolution in fs/ntfs/aops.c::ntfs_read_block() to
1007 cache the current runlist element. This should improve performance
1008 when reading very large and/or very fragmented data.
1009
10102.0.16 - Convert access to $MFT/$BITMAP to attribute inode API.
1011
1012 - Fix a stupid bug introduced in 2.0.15 where we were unmapping the
1013 wrong inode in fs/ntfs/inode.c::ntfs_attr_iget().
1014 - Fix debugging check in fs/ntfs/aops.c::ntfs_read_block().
1015 - Convert $MFT/$BITMAP access to attribute inode API and remove all
1016 remnants of the ugly mftbmp address space and operations hack. This
1017 means we finally have only one readpage function as well as only one
1018 async io completion handler. Yey! The mft bitmap is now just an
1019 attribute inode and is accessed from vol->mftbmp_ino just as if it
1020 were a normal file. Fake inodes rule. (-:
1021
10222.0.15 - Fake inodes based attribute i/o via the pagecache, fixes and cleanups.
1023
1024 - Fix silly bug in fs/ntfs/super.c::parse_options() which was causing
1025 remounts to fail when the partition had an entry in /etc/fstab and
1026 the entry specified the nls= option.
1027 - Apply same macro magic used in fs/ntfs/inode.h to fs/ntfs/volume.h to
1028 expand all the helper functions NVolFoo(), NVolSetFoo(), and
1029 NVolClearFoo().
1030 - Move copyright statement from driver initialisation message to
1031 module description (fs/super.c). This makes the initialisation
1032 message fit on one line and fits in better with rest of kernel.
1033 - Update fs/ntfs/attrib.c::map_run_list() to work on both real and
1034 attribute inodes, and both for files and directories.
1035 - Implement fake attribute inodes allowing all attribute i/o to go via
1036 the page cache and to use all the normal vfs/mm functionality:
1037 - Add ntfs_attr_iget() and its helper ntfs_read_locked_attr_inode()
1038 to fs/ntfs/inode.c.
1039 - Add needed cleanup code to ntfs_clear_big_inode().
1040 - Merge address space operations for files and directories (aops.c),
1041 now just have ntfs_aops:
1042 - Rename:
1043 end_buffer_read_attr_async() -> ntfs_end_buffer_read_async(),
1044 ntfs_attr_read_block() -> ntfs_read_block(),
1045 ntfs_file_read_page() -> ntfs_readpage().
1046 - Rewrite fs/ntfs/aops.c::ntfs_readpage() to work on both real and
1047 attribute inodes, and both for files and directories.
1048 - Remove obsolete fs/ntfs/aops.c::ntfs_mst_readpage().
1049
10502.0.14 - Run list merging code cleanup, minor locking changes, typo fixes.
1051
1052 - Change fs/ntfs/super.c::ntfs_statfs() to not rely on BKL by moving
1053 the locking out of super.c::get_nr_free_mft_records() and taking and
1054 dropping the mftbmp_lock rw_semaphore in ntfs_statfs() itself.
1055 - Bring attribute runlist merging code (fs/ntfs/attrib.c) in sync with
1056 current userspace ntfs library code. This means that if a merge
1057 fails the original runlists are always left unmodified instead of
1058 being silently corrupted.
1059 - Misc typo fixes.
1060
10612.0.13 - Use iget5_locked() in preparation for fake inodes and small cleanups.
1062
1063 - Remove nr_mft_bits and the now superfluous union with nr_mft_records
1064 from ntfs_volume structure.
1065 - Remove nr_lcn_bits and the now superfluous union with nr_clusters
1066 from ntfs_volume structure.
1067 - Use iget5_locked() and friends instead of conventional iget(). Wrap
1068 the call in fs/ntfs/inode.c::ntfs_iget() and update callers of iget()
1069 to use ntfs_iget(). Leave only one iget() call at mount time so we
1070 don't need an ntfs_iget_mount().
1071 - Change fs/ntfs/inode.c::ntfs_new_extent_inode() to take mft_no as an
1072 additional argument.
1073
10742.0.12 - Initial cleanup of address space operations following 2.0.11 changes.
1075
1076 - Merge fs/ntfs/aops.c::end_buffer_read_mst_async() and
1077 fs/ntfs/aops.c::end_buffer_read_file_async() into one function
1078 fs/ntfs/aops.c::end_buffer_read_attr_async() using NInoMstProtected()
1079 to determine whether to apply mst fixups or not.
1080 - Above change allows merging fs/ntfs/aops.c::ntfs_file_read_block()
1081 and fs/ntfs/aops.c::ntfs_mst_readpage() into one function
1082 fs/ntfs/aops.c::ntfs_attr_read_block(). Also, create a tiny wrapper
1083 fs/ntfs/aops.c::ntfs_mst_readpage() to transform the parameters from
1084 the VFS readpage function prototype to the ntfs_attr_read_block()
1085 function prototype.
1086
10872.0.11 - Initial preparations for fake inode based attribute i/o.
1088
1089 - Move definition of ntfs_inode_state_bits to fs/ntfs/inode.h and
1090 do some macro magic (adapted from include/linux/buffer_head.h) to
1091 expand all the helper functions NInoFoo(), NInoSetFoo(), and
1092 NInoClearFoo().
1093 - Add new flag to ntfs_inode_state_bits: NI_Sparse.
1094 - Add new fields to ntfs_inode structure to allow use of fake inodes
1095 for attribute i/o: type, name, name_len. Also add new state bits:
1096 NI_Attr, which, if set, indicates the inode is a fake inode, and
1097 NI_MstProtected, which, if set, indicates the attribute uses multi
1098 sector transfer protection, i.e. fixups need to be applied after
1099 reads and before/after writes.
1100 - Rename fs/ntfs/inode.c::ntfs_{new,clear,destroy}_inode() to
1101 ntfs_{new,clear,destroy}_extent_inode() and update callers.
1102 - Use ntfs_clear_extent_inode() in fs/ntfs/inode.c::__ntfs_clear_inode()
1103 instead of ntfs_destroy_extent_inode().
1104 - Cleanup memory deallocations in {__,}ntfs_clear_{,big_}inode().
1105 - Make all operations on ntfs inode state bits use the NIno* functions.
1106 - Set up the new ntfs inode fields and state bits in
1107 fs/ntfs/inode.c::ntfs_read_inode() and add appropriate cleanup of
1108 allocated memory to __ntfs_clear_inode().
1109 - Cleanup ntfs_inode structure a bit for better ordering of elements
1110 w.r.t. their size to allow better packing of the structure in memory.
1111
11122.0.10 - There can only be 2^32 - 1 inodes on an NTFS volume.
1113
1114 - Add check at mount time to verify that the number of inodes on the
1115 volume does not exceed 2^32 - 1, which is the maximum allowed for
1116 NTFS according to Microsoft.
1117 - Change mft_no member of ntfs_inode structure to be unsigned long.
1118 Update all users. This makes ntfs_inode->mft_no just a copy of struct
1119 inode->i_ino. But we can't just always use struct inode->i_ino and
1120 remove mft_no because extent inodes do not have an attached struct
1121 inode.
1122
11232.0.9 - Decompression engine now uses a single buffer and other cleanups.
1124
1125 - Change decompression engine to use a single buffer protected by a
1126 spin lock instead of per-CPU buffers. (Rusty Russell)
1127 - Do not update cb_pos when handling a partial final page during
1128 decompression of a sparse compression block, as the value is later
1129 reset without being read/used. (Rusty Russell)
1130 - Switch to using the new KM_BIO_SRC_IRQ for atomic kmap()s. (Andrew
1131 Morton)
1132 - Change buffer size in ntfs_readdir()/ntfs_filldir() to use
1133 NLS_MAX_CHARSET_SIZE which makes the buffers almost 1kiB each but
1134 it also makes everything safer so it is a good thing.
1135 - Miscellaneous minor cleanups to comments.
1136
11372.0.8 - Major updates for handling of case sensitivity and dcache aliasing.
1138
1139 Big thanks go to Al Viro and other inhabitants of #kernel for investing
1140 their time to discuss the case sensitivity and dcache aliasing issues.
1141
1142 - Remove unused source file fs/ntfs/attraops.c.
1143 - Remove show_inodes mount option(s), thus dropping support for
1144 displaying of short file names.
1145 - Remove deprecated mount option posix.
1146 - Restore show_sys_files mount option.
1147 - Add new mount option case_sensitive, to determine if the driver
1148 treats file names as case sensitive or not. If case sensitive, create
1149 file names in the POSIX namespace. Otherwise create file names in the
1150 LONG/WIN32 namespace. Note, files remain accessible via their short
1151 file name, if it exists.
1152 - Remove really dumb logic bug in boot sector recovery code.
1153 - Fix dcache aliasing issues wrt short/long file names via changes
1154 to fs/ntfs/dir.c::ntfs_lookup_inode_by_name() and
1155 fs/ntfs/namei.c::ntfs_lookup():
1156 - Add additional argument to ntfs_lookup_inode_by_name() in which we
1157 return information about the matching file name if the case is not
1158 matching or the match is a short file name. See comments above the
1159 function definition for details.
1160 - Change ntfs_lookup() to only create dcache entries for the correctly
1161 cased file name and only for the WIN32 namespace counterpart of DOS
1162 namespace file names. This ensures we have only one dentry per
1163 directory and also removes all dcache aliasing issues between short
1164 and long file names once we add write support. See comments above
1165 function for details.
1166 - Fix potential 1 byte overflow in fs/ntfs/unistr.c::ntfs_ucstonls().
1167
11682.0.7 - Minor cleanups and updates for changes in core kernel code.
1169
1170 - Remove much of the NULL struct element initializers.
1171 - Various updates to make compatible with recent kernels.
1172 - Remove defines of MAX_BUF_PER_PAGE and include linux/buffer_head.h
1173 in fs/ntfs/ntfs.h instead.
1174 - Remove no longer needed KERNEL_VERSION checks. We are now in the
1175 kernel proper so they are no longer needed.
1176
11772.0.6 - Major bugfix to make compatible with other kernel changes.
1178
1179 - Initialize the mftbmp address space properly now that there are more
1180 fields in the struct address_space. This was leading to hangs and
1181 oopses on umount since 2.5.12 because of changes to other parts of
1182 the kernel. We probably want a kernel generic init_address_space()
1183 function...
1184 - Drop BKL from ntfs_readdir() after consultation with Al Viro. The
1185 only caller of ->readdir() is vfs_readdir() which holds i_sem during
1186 the call, and i_sem is sufficient protection against changes in the
1187 directory inode (including ->i_size).
1188 - Use generic_file_llseek() for directories (as opposed to
1189 default_llseek()) as this downs i_sem instead of the BKL which is
1190 what we now need for exclusion against ->f_pos changes considering we
1191 no longer take the BKL in ntfs_readdir().
1192
11932.0.5 - Major bugfix. Buffer overflow in extent inode handling.
1194
1195 - No need to set old blocksize in super.c::ntfs_fill_super() as the
1196 VFS does so via invocation of deactivate_super() calling
1197 fs->fill_super() calling block_kill_super() which does it.
1198 - BKL moved from VFS into dir.c::ntfs_readdir(). (Linus Torvalds)
1199 -> Do we really need it? I don't think so as we have exclusion on
1200 the directory ntfs_inode rw_semaphore mrec_lock. We mmight have to
1201 move the ->f_pos accesses under the mrec_lock though. Check this...
1202 - Fix really, really, really stupid buffer overflow in extent inode
1203 handling in mft.c::map_extent_mft_record().
1204
12052.0.4 - Cleanups and updates for kernel 2.5.11.
1206
1207 - Add documentation on how to use the MD driver to be able to use NTFS
1208 stripe and volume sets in Linux and generally cleanup documentation
1209 a bit.
1210 Remove all uses of kdev_t in favour of struct block_device *:
1211 - Change compress.c::ntfs_file_read_compressed_block() to use
1212 sb_getblk() instead of getblk().
1213 - Change super.c::ntfs_fill_super() to use bdev_hardsect_size() instead
1214 of get_hardsect_size().
1215 - No need to get old blocksize in super.c::ntfs_fill_super() as
1216 fs/super.c::get_sb_bdev() already does this.
1217 - Set bh->b_bdev instead of bh->b_dev throughout aops.c.
1218
12192.0.3 - Small bug fixes, cleanups, and performance improvements.
1220
1221 - Remove some dead code from mft.c.
1222 - Optimize readpage and read_block functions throughout aops.c so that
1223 only initialized blocks are read. Non-initialized ones have their
1224 buffer head mapped, zeroed, and set up to date, without scheduling
1225 any i/o. Thanks to Al Viro for advice on how to avoid the device i/o.
1226 Thanks go to Andrew Morton for spotting the below:
1227 - Fix buglet in allocate_compression_buffers() error code path.
1228 - Call flush_dcache_page() after modifying page cache page contents in
1229 ntfs_file_readpage().
1230 - Check for existence of page buffers throughout aops.c before calling
1231 create_empty_buffers(). This happens when an I/O error occurs and the
1232 read is retried. (It also happens once writing is implemented so that
1233 needed doing anyway but I had left it for later...)
1234 - Don't BUG_ON() uptodate and/or mapped buffers throughout aops.c in
1235 readpage and read_block functions. Reasoning same as above (i.e. I/O
1236 error retries and future write code paths.)
1237
12382.0.2 - Minor updates and cleanups.
1239
1240 - Cleanup: rename mst.c::__post_read_mst_fixup to post_write_mst_fixup
1241 and cleanup the code a bit, removing the unused size parameter.
1242 - Change default fmask to 0177 and update documentation.
1243 - Change attrib.c::get_attr_search_ctx() to return the search context
1244 directly instead of taking the address of a pointer. A return value
1245 of NULL means the allocation failed. Updated all callers
1246 appropriately.
1247 - Update to 2.5.9 kernel (preserving backwards compatibility) by
1248 replacing all occurences of page->buffers with page_buffers(page).
1249 - Fix minor bugs in runlist merging, also minor cleanup.
1250 - Updates to bootsector layout and mft mirror contents descriptions.
1251 - Small bug fix in error detection in unistr.c and some cleanups.
1252 - Grow name buffer allocations in unistr.c in aligned mutlipled of 64
1253 bytes.
1254
12552.0.1 - Minor updates.
1256
1257 - Make default umask correspond to documentation.
1258 - Improve documentation.
1259 - Set default mode to include execute bit. The {u,f,d}mask can be used
1260 to take it away if desired. This allows binaries to be executed from
1261 a mounted ntfs partition.
1262
12632.0.0 - New version number. Remove TNG from the name. Now in the kernel.
1264
1265 - Add kill_super, just keeping up with the vfs changes in the kernel.
1266 - Repeat some changes from tng-0.0.8 that somehow got lost on the way
1267 from the CVS import into BitKeeper.
1268 - Begin to implement proper handling of allocated_size vs
1269 initialized_size vs data_size (i.e. i_size). Done are
1270 mft.c::ntfs_mft_readpage(), aops.c::end_buffer_read_index_async(),
1271 and attrib.c::load_attribute_list().
1272 - Lock the runlist in attrib.c::load_attribute_list() while using it.
1273 - Fix memory leak in ntfs_file_read_compressed_block() and generally
1274 clean up compress.c a little, removing some uncommented/unused debug
1275 code.
1276 - Tidy up dir.c a little bit.
1277 - Don't bother getting the runlist in inode.c::ntfs_read_inode().
1278 - Merge mft.c::ntfs_mft_readpage() and aops.c::ntfs_index_readpage()
1279 creating aops.c::ntfs_mst_readpage(), improving the handling of
1280 holes and overflow in the process and implementing the correct
1281 equivalent of ntfs_file_get_block() in ntfs_mst_readpage() itself.
1282 I am aiming for correctness at the moment. Modularisation can come
1283 later.
1284 - Rename aops.c::end_buffer_read_index_async() to
1285 end_buffer_read_mst_async() and optimize the overflow checking and
1286 handling.
1287 - Use the host of the mftbmp address space mapping to hold the ntfs
1288 volume. This is needed so the async i/o completion handler can
1289 retrieve a pointer to the volume. Hopefully this will not cause
1290 problems elsewhere in the kernel... Otherwise will need to use a
1291 fake inode.
1292 - Complete implementation of proper handling of allocated_size vs
1293 initialized_size vs data_size (i.e. i_size) in whole driver.
1294 Basically aops.c is now completely rewritten.
1295 - Change NTFS driver name to just NTFS and set version number to 2.0.0
1296 to make a clear distinction from the old driver which is still on
1297 version 1.1.22.
1298
1299tng-0.0.8 - 08/03/2002 - Now using BitKeeper, http://linux-ntfs.bkbits.net/
1300
1301 - Replace bdevname(sb->s_dev) with sb->s_id.
1302 - Remove now superfluous new-line characters in all callers of
1303 ntfs_debug().
1304 - Apply kludge in ntfs_read_inode(), setting i_nlink to 1 for
1305 directories. Without this the "find" utility gets very upset which is
1306 fair enough as Linux/Unix do not support directory hard links.
1307 - Further runlist merging work. (Richard Russon)
1308 - Backwards compatibility for gcc-2.95. (Richard Russon)
1309 - Update to kernel 2.5.5-pre1 and rediff the now tiny patch.
c002f425 1310 - Convert to new filesystem declaration using ->ntfs_get_sb() and
1da177e4
LT
1311 replacing ntfs_read_super() with ntfs_fill_super().
1312 - Set s_maxbytes to MAX_LFS_FILESIZE to avoid page cache page index
1313 overflow on 32-bit architectures.
1314 - Cleanup upcase loading code to use ntfs_(un)map_page().
1315 - Disable/reenable preemtion in critical sections of compession engine.
1316 - Replace device size determination in ntfs_fill_super() with
1317 sb->s_bdev->bd_inode->i_size (in bytes) and remove now superfluous
1318 function super.c::get_nr_blocks().
1319 - Implement a mount time option (show_inodes) allowing choice of which
1320 types of inode names readdir() returns and modify ntfs_filldir()
1321 accordingly. There are several parameters to show_inodes:
1322 system: system files
1323 win32: long file names (including POSIX file names) [DEFAULT]
1324 long: same as win32
1325 dos: short file names only (excluding POSIX file names)
1326 short: same as dos
1327 posix: same as both win32 and dos
1328 all: all file names
1329 Note that the options are additive, i.e. specifying:
1330 -o show_inodes=system,show_inodes=win32,show_inodes=dos
1331 is the same as specifying:
1332 -o show_inodes=all
1333 Note that the "posix" and "all" options will show all directory
1334 names, BUT the link count on each directory inode entry is set to 1,
1335 due to Linux not supporting directory hard links. This may well
1336 confuse some userspace applications, since the directory names will
1337 have the same inode numbers. Thus it is NOT advisable to use the
1338 "posix" or "all" options. We provide them only for completeness sake.
1339 - Add copies of allocated_size, initialized_size, and compressed_size to
1340 the ntfs inode structure and set them up in
1341 inode.c::ntfs_read_inode(). These reflect the unnamed data attribute
1342 for files and the index allocation attribute for directories.
1343 - Add copies of allocated_size and initialized_size to ntfs inode for
1344 $BITMAP attribute of large directories and set them up in
1345 inode.c::ntfs_read_inode().
1346 - Add copies of allocated_size and initialized_size to ntfs volume for
1347 $BITMAP attribute of $MFT and set them up in
1348 super.c::load_system_files().
1349 - Parse deprecated ntfs driver options (iocharset, show_sys_files,
1350 posix, and utf8) and tell user what the new options to use are. Note
1351 we still do support them but they will be removed with kernel 2.7.x.
1352 - Change all occurences of integer long long printf formatting to hex
1353 as printk() will not support long long integer format if/when the
1354 div64 patch goes into the kernel.
1355 - Make slab caches have stable names and change the names to what they
1356 were intended to be. These changes are required/made possible by the
1357 new slab cache name handling which removes the length limitation by
1358 requiring the caller of kmem_cache_create() to supply a stable name
1359 which is then referenced but not copied.
1360 - Rename run_list structure to run_list_element and create a new
1361 run_list structure containing a pointer to a run_list_element
1362 structure and a read/write semaphore. Adapt all users of runlists
1363 to new scheme and take and release the lock as needed. This fixes a
1364 nasty race as the run_list changes even when inodes are locked for
1365 reading and even when the inode isn't locked at all, so we really
1366 needed the serialization. We use a semaphore rather than a spinlock
1367 as memory allocations can sleep and doing everything GFP_ATOMIC
1368 would be silly.
1369 - Cleanup read_inode() removing all code checking for lowest_vcn != 0.
1370 This can never happen due to the nature of lookup_attr() and how we
1371 support attribute lists. If it did happen it would imply the inode
1372 being corrupt.
1373 - Check for lowest_vcn != 0 in ntfs_read_inode() and mark the inode as
1374 bad if found.
1375 - Update to 2.5.6-pre2 changes in struct address_space.
1376 - Use parent_ino() when accessing d_parent inode number in dir.c.
1377 - Import Sourceforge CVS repository into BitKeeper repository:
1378 http://linux-ntfs.bkbits.net/ntfs-tng-2.5
1379 - Update fs/Makefile, fs/Config.help, fs/Config.in, and
1380 Documentation/filesystems/ntfs.txt for NTFS TNG.
1381 - Create kernel configuration option controlling whether debugging
1382 is enabled or not.
1383 - Add the required export of end_buffer_io_sync() from the patches
1384 directory to the kernel code.
1385 - Update inode.c::ntfs_show_options() with show_inodes mount option.
1386 - Update errors mount option.
1387
1388tng-0.0.7 - 13/02/2002 - The driver is now feature complete for read-only!
1389
1390 - Cleanup mft.c and it's debug/error output in particular. Fix a minor
1391 bug in mapping of extent inodes. Update all the comments to fit all
1392 the recent code changes.
1393 - Modify vcn_to_lcn() to cope with entirely unmapped runlists.
1394 - Cleanups in compress.c, mostly comments and folding help.
1395 - Implement attrib.c::map_run_list() as a generic helper.
1396 - Make compress.c::ntfs_file_read_compressed_block() use map_run_list()
1397 thus making code shorter and enabling attribute list support.
1398 - Cleanup incorrect use of [su]64 with %L printf format specifier in
1399 all source files. Type casts to [unsigned] long long added to correct
1400 the mismatches (important for architectures which have long long not
1401 being 64 bits).
1402 - Merge async io completion handlers for directory indexes and $MFT
1403 data into one by setting the index_block_size{_bits} of the ntfs
1404 inode for $MFT to the mft_record_size{_bits} of the ntfs_volume.
1405 - Cleanup aops.c, update comments.
1406 - Make ntfs_file_get_block() use map_run_list() so all files now
1407 support attribute lists.
1408 - Make ntfs_dir_readpage() almost verbatim copy of
1409 block_read_full_page() by using ntfs_file_get_block() with only real
1410 difference being the use of our own async io completion handler
1411 rather than the default one, thus reducing the amount of code and
1412 automatically enabling attribute list support for directory indices.
1413 - Fix bug in load_attribute_list() - forgot to call brelse in error
1414 code path.
1415 - Change parameters to find_attr() and lookup_attr(). We no longer
1416 pass in the upcase table and its length. These can be gotten from
1417 ctx->ntfs_ino->vol->upcase{_len}. Update all callers.
1418 - Cleanups in attrib.c.
1419 - Implement merging of runlists, attrib.c::merge_run_lists() and its
1420 helpers. (Richard Russon)
1421 - Attribute lists part 2, attribute extents and multi part runlists:
1422 enable proper support for LCN_RL_NOT_MAPPED and automatic mapping of
1423 further runlist parts via attrib.c::map_run_list().
1424 - Tiny endianness bug fix in decompress_mapping_pairs().
1425
1426tng-0.0.6 - Encrypted directories, bug fixes, cleanups, debugging enhancements.
1427
1428 - Enable encrypted directories. (Their index root is marked encrypted
1429 to indicate that new files in that directory should be created
1430 encrypted.)
1431 - Fix bug in NInoBmpNonResident() macro. (Cut and paste error.)
1432 - Enable $Extend system directory. Most (if not all) extended system
1433 files do not have unnamed data attributes so ntfs_read_inode() had to
1434 special case them but that is ok, as the special casing recovery
1435 happens inside an error code path so there is zero slow down in the
1436 normal fast path. The special casing is done by introducing a new
1437 function inode.c::ntfs_is_extended_system_file() which checks if any
1438 of the hard links in the inode point to $Extend as being their parent
1439 directory and if they do we assume this is an extended system file.
1440 - Create a sysctl/proc interface to allow {dis,en}abling of debug output
1441 when compiled with -DDEBUG. Default is debug messages to be disabled.
1442 To enable them, one writes a non-zero value to /proc/sys/fs/ntfs-debug
1443 (if /proc is enabled) or uses sysctl(2) to effect the same (if sysctl
1444 interface is enabled). Inspired by old ntfs driver.
1445 - Add debug_msgs insmod/kernel boot parameter to set whether debug
1446 messages are {dis,en}abled. This is useful to enable debug messages
1447 during ntfs initialization and is the only way to activate debugging
1448 when the sysctl interface is not enabled.
1449 - Cleanup debug output in various places.
1450 - Remove all dollar signs ($) from the source (except comments) to
1451 enable compilation on architectures whose gcc compiler does not
1452 support dollar signs in the names of variables/constants. Attribute
1453 types now start with AT_ instead of $ and $I30 is now just I30.
1454 - Cleanup ntfs_lookup() and add consistency check of sequence numbers.
1455 - Load complete runlist for $MFT/$BITMAP during mount and cleanup
1456 access functions. This means we now cope with $MFT/$BITMAP being
1457 spread accross several mft records.
1458 - Disable modification of mft_zone_multiplier on remount. We can always
1459 reenable this later on if we really want to, but we will need to make
1460 sure we readjust the mft_zone size / layout accordingly.
1461
1462tng-0.0.5 - Modernize for 2.5.x and further in line-ing with Al Viro's comments.
1463
1464 - Use sb_set_blocksize() instead of set_blocksize() and verify the
1465 return value.
1466 - Use sb_bread() instead of bread() throughout.
1467 - Add index_vcn_size{_bits} to ntfs_inode structure to store the size
1468 of a directory index block vcn. Apply resulting simplifications in
1469 dir.c everywhere.
1470 - Fix a small bug somewhere (but forgot what it was).
1471 - Change ntfs_{debug,error,warning} to enable gcc to do type checking
1472 on the printf-format parameter list and fix bugs reported by gcc
1473 as a result. (Richard Russon)
1474 - Move inode allocation strategy to Al's new stuff but maintain the
1475 divorce of ntfs_inode from struct inode. To achieve this we have two
1476 separate slab caches, one for big ntfs inodes containing a struct
1477 inode and pure ntfs inodes and at the same time fix some faulty
1478 error code paths in ntfs_read_inode().
1479 - Show mount options in proc (inode.c::ntfs_show_options()).
1480
1481tng-0.0.4 - Big changes, getting in line with Al Viro's comments.
1482
1483 - Modified (un)map_mft_record functions to be common for read and write
1484 case. To specify which is which, added extra parameter at front of
1485 parameter list. Pass either READ or WRITE to this, each has the
1486 obvious meaning.
1487 - General cleanups to allow for easier folding in vi.
1488 - attrib.c::decompress_mapping_pairs() now accepts the old runlist
1489 argument, and invokes attrib.c::merge_run_lists() to merge the old
1490 and the new runlists.
1491 - Removed attrib.c::find_first_attr().
1492 - Implemented loading of attribute list and complete runlist for $MFT.
1493 This means we now cope with $MFT being spread across several mft
1494 records.
1495 - Adapt to 2.5.2-pre9 and the changed create_empty_buffers() syntax.
1496 - Adapt major/minor/kdev_t/[bk]devname stuff to new 2.5.x kernels.
1497 - Make ntfs_volume be allocated via kmalloc() instead of using a slab
1498 cache. There are too little ntfs_volume structures at any one time
1499 to justify a private slab cache.
1500 - Fix bogus kmap() use in async io completion. Now use kmap_atomic().
1501 Use KM_BIO_IRQ on advice from IRC/kernel...
1502 - Use ntfs_map_page() in map_mft_record() and create ->readpage method
1503 for reading $MFT (ntfs_mft_readpage). In the process create dedicated
1504 address space operations (ntfs_mft_aops) for $MFT inode mapping. Also
1505 removed the now superfluous exports from the kernel core patch.
1506 - Fix a bug where kfree() was used insted of ntfs_free().
1507 - Change map_mft_record() to take ntfs_inode as argument instead of
1508 vfs inode. Dito for unmap_mft_record(). Adapt all callers.
1509 - Add pointer to ntfs_volume to ntfs_inode.
1510 - Add mft record number and sequence number to ntfs_inode. Stop using
1511 i_ino and i_generation for in-driver purposes.
1512 - Implement attrib.c::merge_run_lists(). (Richard Russon)
1513 - Remove use of proper inodes by extent inodes. Move i_ino and
1514 i_generation to ntfs_inode to do this. Apply simplifications that
1515 result and remove iget_no_wait(), etc.
1516 - Pass ntfs_inode everywhere in the driver (used to be struct inode).
1517 - Add reference counting in ntfs_inode for the ntfs inode itself and
1518 for the mapped mft record.
1519 - Extend mft record mapping so we can (un)map extent mft records (new
1520 functions (un)map_extent_mft_record), and so mappings are reference
1521 counted and don't have to happen twice if already mapped - just ref
1522 count increases.
1523 - Add -o iocharset as alias to -o nls for backwards compatibility.
1524 - The latest core patch is now tiny. In fact just a single additional
1525 export is necessary over the base kernel.
1526
1527tng-0.0.3 - Cleanups, enhancements, bug fixes.
1528
1529 - Work on attrib.c::decompress_mapping_pairs() to detect base extents
1530 and setup the runlist appropriately using knowledge provided by the
1531 sizes in the base attribute record.
1532 - Balance the get_/put_attr_search_ctx() calls so we don't leak memory
1533 any more.
1534 - Introduce ntfs_malloc_nofs() and ntfs_free() to allocate/free a single
1535 page or use vmalloc depending on the amount of memory requested.
1536 - Cleanup error output. The __FUNCTION__ "(): " is now added
1537 automatically. Introduced a new header file debug.h to support this
1538 and also moved ntfs_debug() function into it.
1539 - Make reading of compressed files more intelligent and especially get
1540 rid of the vmalloc_nofs() from readpage(). This now uses per CPU
1541 buffers (allocated at first mount with cluster size <= 4kiB and
1542 deallocated on last umount with cluster size <= 4kiB), and
1543 asynchronous io for the compressed data using a list of buffer heads.
1544 Er, we use synchronous io as async io only works on whole pages
1545 covered by buffers and not on individual buffer heads...
1546 - Bug fix for reading compressed files with sparse compression blocks.
1547
1548tng-0.0.2 - Now handles larger/fragmented/compressed volumes/files/dirs.
1549
1550 - Fixed handling of directories when cluster size exceeds index block
1551 size.
1552 - Hide DOS only name space directory entries from readdir() but allow
1553 them in lookup(). This should fix the problem that Linux doesn't
1554 support directory hard links, while still allowing access to entries
1555 via their short file name. This also has the benefit of mimicking
1556 what Windows users are used to, so it is the ideal solution.
1557 - Implemented sync_page everywhere so no more hangs in D state when
1558 waiting for a page.
1559 - Stop using bforget() in favour of brelse().
1560 - Stop locking buffers unnecessarily.
1561 - Implemented compressed files (inode->mapping contains uncompressed
1562 data, raw compressed data is currently bread() into a vmalloc()ed
1563 memory buffer).
1564 - Enable compressed directories. (Their index root is marked compressed
1565 to indicate that new files in that directory should be created
1566 compressed.)
1567 - Use vsnprintf rather than vsprintf in the ntfs_error and ntfs_warning
1568 functions. (Thanks to Will Dyson for pointing this out.)
1569 - Moved the ntfs_inode and ntfs_volume (the former ntfs_inode_info and
1570 ntfs_sb_info) out of the common inode and super_block structures and
1571 started using the generic_ip and generic_sbp pointers instead. This
1572 makes ntfs entirely private with respect to the kernel tree.
1573 - Detect compiler version and abort with error message if gcc less than
1574 2.96 is used.
1575 - Fix bug in name comparison function in unistr.c.
1576 - Implement attribute lists part 1, the infrastructure: search contexts
1577 and operations, find_external_attr(), lookup_attr()) and make the
1578 code use the infrastructure.
1579 - Fix stupid buffer overflow bug that became apparent on larger run
1580 list containing attributes.
1581 - Fix bugs in readdir() that became apparent on larger directories.
1582
1583 The driver is now really useful and survives the test
1584 find . -type f -exec md5sum "{}" \;
1585 without any error messages on a over 1GiB sized partition with >16k
1586 files on it, including compressed files and directories and many files
1587 and directories with attribute lists.
1588
1589tng-0.0.1 - The first useful version.
1590
1591 - Added ntfs_lookup().
1592 - Added default upcase generation and handling.
1593 - Added compile options to be shown on module init.
1594 - Many bug fixes that were "hidden" before.
1595 - Update to latest kernel.
1596 - Added ntfs_readdir().
1597 - Added file operations for mmap(), read(), open() and llseek(). We just
1598 use the generic ones. The whole point of going through implementing
1599 readpage() methods and where possible get_block() call backs is that
1600 this allows us to make use of the generic high level methods provided
1601 by the kernel.
1602
1603 The driver is now actually useful! Yey. (-: It undoubtedly has got bugs
1604 though and it doesn't implement accesssing compressed files yet. Also,
1605 accessing files with attribute list attributes is not implemented yet
c002f425 1606 either. But for small or simple filesystems it should work and allow
1da177e4
LT
1607 you to list directories, use stat on directory entries and the file
1608 system, open, read, mmap and llseek around in files. A big mile stone
1609 has been reached!
1610
1611tng-0.0.0 - Initial version tag.
1612
1613 Initial driver implementation. The driver can mount and umount simple
c002f425 1614 NTFS filesystems (i.e. ones without attribute lists in the system
1da177e4
LT
1615 files). If the mount fails there might be problems in the error handling
1616 code paths, so be warned. Otherwise it seems to be loading the system
1617 files nicely and the mft record read mapping/unmapping seems to be
1618 working nicely, too. Proof of inode metadata in the page cache and non-
1619 resident file unnamed stream data in the page cache concepts is thus
1620 complete.