src/doc/rustdoc/src/documentation-tests.md

   1 # Documentation tests
   2
   3 `rustdoc` supports executing your documentation examples as tests. This makes sure
   4 that your tests are up to date and working.
   5
   6 The basic idea is this:
   7
   8 ```ignore
   9 /// # Examples
  10 ///
  11 /// ```
  12 /// let x = 5;
  13 /// ```
  14 ```
  15
  16 The triple backticks start and end code blocks. If this were in a file named `foo.rs`,
  17 running `rustdoc --test foo.rs` will extract this example, and then run it as a test.
  18
  19 Please note that by default, if no language is set for the block code, `rustdoc`
  20 assumes it is `Rust` code. So the following:
  21
  22 ``````markdown
  23 ```rust
  24 let x = 5;
  25 ```
  26 ``````
  27
  28 is strictly equivalent to:
  29
  30 ``````markdown
  31 ```
  32 let x = 5;
  33 ```
  34 ``````
  35
  36 There's some subtlety though! Read on for more details.
  37
  38 ## Passing or failing a doctest
  39
  40 Like regular unit tests, regular doctests are considered to "pass"
  41 if they compile and run without panicking.
  42 So if you want to demonstrate that some computation gives a certain result,
  43 the `assert!` family of macros works the same as other Rust code:
  44
  45 ```rust
  46 let foo = "foo";
  47
  48 assert_eq!(foo, "foo");
  49 ```
  50
  51 This way, if the computation ever returns something different,
  52 the code panics and the doctest fails.
  53
  54 ## Pre-processing examples
  55
  56 In the example above, you'll note something strange: there's no `main`
  57 function! Forcing you to write `main` for every example, no matter how small,
  58 adds friction. So `rustdoc` processes your examples slightly before
  59 running them. Here's the full algorithm rustdoc uses to preprocess examples:
  60
  61 1. Some common `allow` attributes are inserted, including
  62    `unused_variables`, `unused_assignments`, `unused_mut`,
  63    `unused_attributes`, and `dead_code`. Small examples often trigger
  64    these lints.
  65 2. Any attributes specified with `#![doc(test(attr(...)))]` are added.
  66 3. Any leading `#![foo]` attributes are left intact as crate attributes.
  67 4. If the example does not contain `extern crate`, and
  68    `#![doc(test(no_crate_inject))]` was not specified, then `extern crate
  69    <mycrate>;` is inserted (note the lack of `#[macro_use]`).
  70 5. Finally, if the example does not contain `fn main`, the remainder of the
  71    text is wrapped in `fn main() { your_code }`.
  72
  73 For more about that caveat in rule 4, see "Documenting Macros" below.
  74
  75 ## Hiding portions of the example
  76
  77 Sometimes, you need some setup code, or other things that would distract
  78 from your example, but are important to make the tests work. Consider
  79 an example block that looks like this:
  80
  81 ```text
  82 /// /// Some documentation.
  83 /// # fn foo() {} // this function will be hidden
  84 /// println!("Hello, World!");
  85 ```
  86
  87 It will render like this:
  88
  89 ```rust
  90 /// Some documentation.
  91 # fn foo() {}
  92 println!("Hello, World!");
  93 ```
  94
  95 Yes, that's right: you can add lines that start with `# `, and they will
  96 be hidden from the output, but will be used when compiling your code. You
  97 can use this to your advantage. In this case, documentation comments need
  98 to apply to some kind of function, so if I want to show you just a
  99 documentation comment, I need to add a little function definition below
 100 it. At the same time, it's only there to satisfy the compiler, so hiding
 101 it makes the example more clear. You can use this technique to explain
 102 longer examples in detail, while still preserving the testability of your
 103 documentation.
 104
 105 For example, imagine that we wanted to document this code:
 106
 107 ```rust
 108 let x = 5;
 109 let y = 6;
 110 println!("{}", x + y);
 111 ```
 112
 113 We might want the documentation to end up looking like this:
 114
 115 > First, we set `x` to five:
 116 >
 117 > ```rust
 118 > let x = 5;
 119 > # let y = 6;
 120 > # println!("{}", x + y);
 121 > ```
 122 >
 123 > Next, we set `y` to six:
 124 >
 125 > ```rust
 126 > # let x = 5;
 127 > let y = 6;
 128 > # println!("{}", x + y);
 129 > ```
 130 >
 131 > Finally, we print the sum of `x` and `y`:
 132 >
 133 > ```rust
 134 > # let x = 5;
 135 > # let y = 6;
 136 > println!("{}", x + y);
 137 > ```
 138
 139 To keep each code block testable, we want the whole program in each block, but
 140 we don't want the reader to see every line every time.  Here's what we put in
 141 our source code:
 142
 143 ``````markdown
 144 First, we set `x` to five:
 145
 146 ```
 147 let x = 5;
 148 # let y = 6;
 149 # println!("{}", x + y);
 150 ```
 151
 152 Next, we set `y` to six:
 153
 154 ```
 155 # let x = 5;
 156 let y = 6;
 157 # println!("{}", x + y);
 158 ```
 159
 160 Finally, we print the sum of `x` and `y`:
 161
 162 ```
 163 # let x = 5;
 164 # let y = 6;
 165 println!("{}", x + y);
 166 ```
 167 ``````
 168
 169 By repeating all parts of the example, you can ensure that your example still
 170 compiles, while only showing the parts that are relevant to that part of your
 171 explanation.
 172
 173 The `#`-hiding of lines can be prevented by using two consecutive hashes
 174 `##`. This only needs to be done with with the first `#` which would've
 175 otherwise caused hiding. If we have a string literal like the following,
 176 which has a line that starts with a `#`:
 177
 178 ```rust
 179 let s = "foo
 180 ## bar # baz";
 181 ```
 182
 183 We can document it by escaping the initial `#`:
 184
 185 ```text
 186 /// let s = "foo
 187 /// ## bar # baz";
 188 ```
 189
 190
 191 ## Using `?` in doc tests
 192
 193 When writing an example, it is rarely useful to include a complete error
 194 handling, as it would add significant amounts of boilerplate code. Instead, you
 195 may want the following:
 196
 197 ```ignore
 198 /// ```
 199 /// use std::io;
 200 /// let mut input = String::new();
 201 /// io::stdin().read_line(&mut input)?;
 202 /// ```
 203 ```
 204
 205 The problem is that `?` returns a `Result<T, E>` and test functions don't
 206 return anything, so this will give a mismatched types error.
 207
 208 You can get around this limitation by manually adding a `main` that returns
 209 `Result<T, E>`, because `Result<T, E>` implements the `Termination` trait:
 210
 211 ```ignore
 212 /// A doc test using ?
 213 ///
 214 /// ```
 215 /// use std::io;
 216 ///
 217 /// fn main() -> io::Result<()> {
 218 ///     let mut input = String::new();
 219 ///     io::stdin().read_line(&mut input)?;
 220 ///     Ok(())
 221 /// }
 222 /// ```
 223 ```
 224
 225 Together with the `# ` from the section above, you arrive at a solution that
 226 appears to the reader as the initial idea but works with doc tests:
 227
 228 ```ignore
 229 /// ```
 230 /// use std::io;
 231 /// # fn main() -> io::Result<()> {
 232 /// let mut input = String::new();
 233 /// io::stdin().read_line(&mut input)?;
 234 /// # Ok(())
 235 /// # }
 236 /// ```
 237 ```
 238
 239 ## Documenting macros
 240
 241 Here’s an example of documenting a macro:
 242
 243 ```rust
 244 /// Panic with a given message unless an expression evaluates to true.
 245 ///
 246 /// # Examples
 247 ///
 248 /// ```
 249 /// # #[macro_use] extern crate foo;
 250 /// # fn main() {
 251 /// panic_unless!(1 + 1 == 2, “Math is broken.”);
 252 /// # }
 253 /// ```
 254 ///
 255 /// ```should_panic
 256 /// # #[macro_use] extern crate foo;
 257 /// # fn main() {
 258 /// panic_unless!(true == false, “I’m broken.”);
 259 /// # }
 260 /// ```
 261 #[macro_export]
 262 macro_rules! panic_unless {
 263     ($condition:expr, $($rest:expr),+) => ({ if ! $condition { panic!($($rest),+); } });
 264 }
 265 # fn main() {}
 266 ```
 267
 268 You’ll note three things: we need to add our own `extern crate` line, so that
 269 we can add the `#[macro_use]` attribute. Second, we’ll need to add our own
 270 `main()` as well (for reasons discussed above). Finally, a judicious use of
 271 `#` to comment out those two things, so they don’t show up in the output.
 272
 273 ## Attributes
 274
 275 There are a few annotations that are useful to help `rustdoc` do the right
 276 thing when testing your code:
 277
 278 ```rust
 279 /// ```ignore
 280 /// fn foo() {
 281 /// ```
 282 # fn foo() {}
 283 ```
 284
 285 The `ignore` directive tells Rust to ignore your code. This is almost never
 286 what you want, as it's the most generic. Instead, consider annotating it
 287 with `text` if it's not code, or using `#`s to get a working example that
 288 only shows the part you care about.
 289
 290 ```rust
 291 /// ```should_panic
 292 /// assert!(false);
 293 /// ```
 294 # fn foo() {}
 295 ```
 296
 297 `should_panic` tells `rustdoc` that the code should compile correctly, but
 298 not actually pass as a test.
 299
 300 ```text
 301 /// ```no_run
 302 /// loop {
 303 ///     println!("Hello, world");
 304 /// }
 305 /// ```
 306 # fn foo() {}
 307 ```
 308
 309 The `no_run` attribute will compile your code, but not run it. This is
 310 important for examples such as "Here's how to retrieve a web page,"
 311 which you would want to ensure compiles, but might be run in a test
 312 environment that has no network access.
 313
 314 ```text
 315 /// ```compile_fail
 316 /// let x = 5;
 317 /// x += 2; // shouldn't compile!
 318 /// ```
 319 ```
 320
 321 `compile_fail` tells `rustdoc` that the compilation should fail. If it
 322 compiles, then the test will fail. However please note that code failing
 323 with the current Rust release may work in a future release, as new features
 324 are added.
 325
 326 ## Syntax reference
 327
 328 The *exact* syntax for code blocks, including the edge cases, can be found
 329 in the [Fenced Code Blocks](https://spec.commonmark.org/0.28/#fenced-code-blocks)
 330 section of the CommonMark specification.
 331
 332 Rustdoc also accepts *indented* code blocks as an alternative to fenced
 333 code blocks: instead of surrounding your code with three backticks, you
 334 can indent each line by four or more spaces.
 335
 336 ``````markdown
 337     let foo = "foo";
 338     assert_eq!(foo, "foo");
 339 ``````
 340
 341 These, too, are documented in the CommonMark specification, in the
 342 [Indented Code Blocks](https://spec.commonmark.org/0.28/#indented-code-blocks)
 343 section.
 344
 345 However, it's preferable to use fenced code blocks over indented code blocks.
 346 Not only are fenced code blocks considered more idiomatic for Rust code,
 347 but there is no way to use directives such as `ignore` or `should_panic` with
 348 indented code blocks.