├── doc └── img │ └── the-book-of-secret-knowledge-preview.png ├── CONTRIBUTING.md ├── CODE_OF_CONDUCT.md ├── LICENSE.md └── README.md /doc/img/the-book-of-secret-knowledge-preview.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/gfoss/the-book-of-secret-knowledge/master/doc/img/the-book-of-secret-knowledge-preview.png -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- 1 | # Contributing 2 | 3 | If you would like to support this project, you have an interesting idea how to improve the operation of this tool or if you found some errors - do fork this add your fixes and add pull-request of your branch to the **master branch**. 4 | 5 | ## Signature of commit 6 | 7 | Moving forward all commits to this project must include a "signed-off-by" line indicating the name and email address of the contributor signing off on the change. To enable signatures add the following lines to `.git/hooks/prepare-commit-msg` : 8 | 9 | ``` 10 | SOB=$(git var GIT_AUTHOR_IDENT | sed -n 's/^\(.*>\).*$/- signed-off-by: \1/p') 11 | grep -qs "^$SOB" "$1" || echo "$SOB" >> "$1" 12 | ``` 13 | 14 | ## Pull requests 15 | 16 | When creating pull request, please heed the following: 17 | 18 | - Base your code on the latest master branch to avoid manual merges 19 | - Code review may ensue in order to help shape your proposal 20 | - Explain the problem and your proposed solution 21 | - One-line description - please don't continue the description on new lines 22 | -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- 1 | # Contributor Covenant Code of Conduct 2 | 3 | ## Our Pledge 4 | 5 | In the interest of fostering an open and welcoming environment, we as contributors and maintainers pledge to making participation in our project and our community a harassment-free experience for everyone, regardless of age, body size, disability, ethnicity, gender identity and expression, level of experience, nationality, personal appearance, race, religion, or sexual identity and orientation. 6 | 7 | ## Our Standards 8 | 9 | Examples of behavior that contributes to creating a positive environment include: 10 | 11 | * Using welcoming and inclusive language 12 | * Being respectful of differing viewpoints and experiences 13 | * Gracefully accepting constructive criticism 14 | * Focusing on what is best for the community 15 | * Showing empathy towards other community members 16 | 17 | Examples of unacceptable behavior by participants include: 18 | 19 | * The use of sexualized language or imagery and unwelcome sexual attention or advances 20 | * Trolling, insulting/derogatory comments, and personal or political attacks 21 | * Public or private harassment 22 | * Publishing others' private information, such as a physical or electronic address, without explicit permission 23 | * Other conduct which could reasonably be considered inappropriate in a professional setting 24 | 25 | ## Our Responsibilities 26 | 27 | Project maintainers are responsible for clarifying the standards of acceptable behavior and are expected to take appropriate and fair corrective action in response to any instances of unacceptable behavior. 28 | 29 | Project maintainers have the right and responsibility to remove, edit, or reject comments, commits, code, wiki edits, issues, and other contributions that are not aligned to this Code of Conduct, or to ban temporarily or permanently any contributor for other behaviors that they deem inappropriate, threatening, offensive, or harmful. 30 | 31 | ## Scope 32 | 33 | This Code of Conduct applies both within project spaces and in public spaces when an individual is representing the project or its community. Examples of representing a project or community include using an official project e-mail address, posting via an official social media account, or acting as an appointed representative at an online or offline event. Representation of a project may be further defined and clarified by project maintainers. 34 | 35 | ## Enforcement 36 | 37 | Instances of abusive, harassing, or otherwise unacceptable behavior may be reported by contacting the project team at trimstray@gmail.com. The project team will review and investigate all complaints, and will respond in a way that it deems appropriate to the circumstances. The project team is obligated to maintain confidentiality with regard to the reporter of an incident. Further details of specific enforcement policies may be posted separately. 38 | 39 | Project maintainers who do not follow or enforce the Code of Conduct in good faith may face temporary or permanent repercussions as determined by other members of the project's leadership. 40 | 41 | ## Attribution 42 | 43 | This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4, available at [http://contributor-covenant.org/version/1/4][version] 44 | 45 | [homepage]: http://contributor-covenant.org 46 | [version]: http://contributor-covenant.org/version/1/4/ 47 | -------------------------------------------------------------------------------- /LICENSE.md: -------------------------------------------------------------------------------- 1 | ### GNU GENERAL PUBLIC LICENSE 2 | 3 | Version 3, 29 June 2007 4 | 5 | Copyright (C) 2007 Free Software Foundation, Inc. 6 | 7 | 8 | Everyone is permitted to copy and distribute verbatim copies of this 9 | license document, but changing it is not allowed. 10 | 11 | ### Preamble 12 | 13 | The GNU General Public License is a free, copyleft license for 14 | software and other kinds of works. 15 | 16 | The licenses for most software and other practical works are designed 17 | to take away your freedom to share and change the works. By contrast, 18 | the GNU General Public License is intended to guarantee your freedom 19 | to share and change all versions of a program--to make sure it remains 20 | free software for all its users. We, the Free Software Foundation, use 21 | the GNU General Public License for most of our software; it applies 22 | also to any other work released this way by its authors. You can apply 23 | it to your programs, too. 24 | 25 | When we speak of free software, we are referring to freedom, not 26 | price. Our General Public Licenses are designed to make sure that you 27 | have the freedom to distribute copies of free software (and charge for 28 | them if you wish), that you receive source code or can get it if you 29 | want it, that you can change the software or use pieces of it in new 30 | free programs, and that you know you can do these things. 31 | 32 | To protect your rights, we need to prevent others from denying you 33 | these rights or asking you to surrender the rights. Therefore, you 34 | have certain responsibilities if you distribute copies of the 35 | software, or if you modify it: responsibilities to respect the freedom 36 | of others. 37 | 38 | For example, if you distribute copies of such a program, whether 39 | gratis or for a fee, you must pass on to the recipients the same 40 | freedoms that you received. You must make sure that they, too, receive 41 | or can get the source code. And you must show them these terms so they 42 | know their rights. 43 | 44 | Developers that use the GNU GPL protect your rights with two steps: 45 | (1) assert copyright on the software, and (2) offer you this License 46 | giving you legal permission to copy, distribute and/or modify it. 47 | 48 | For the developers' and authors' protection, the GPL clearly explains 49 | that there is no warranty for this free software. For both users' and 50 | authors' sake, the GPL requires that modified versions be marked as 51 | changed, so that their problems will not be attributed erroneously to 52 | authors of previous versions. 53 | 54 | Some devices are designed to deny users access to install or run 55 | modified versions of the software inside them, although the 56 | manufacturer can do so. This is fundamentally incompatible with the 57 | aim of protecting users' freedom to change the software. The 58 | systematic pattern of such abuse occurs in the area of products for 59 | individuals to use, which is precisely where it is most unacceptable. 60 | Therefore, we have designed this version of the GPL to prohibit the 61 | practice for those products. If such problems arise substantially in 62 | other domains, we stand ready to extend this provision to those 63 | domains in future versions of the GPL, as needed to protect the 64 | freedom of users. 65 | 66 | Finally, every program is threatened constantly by software patents. 67 | States should not allow patents to restrict development and use of 68 | software on general-purpose computers, but in those that do, we wish 69 | to avoid the special danger that patents applied to a free program 70 | could make it effectively proprietary. To prevent this, the GPL 71 | assures that patents cannot be used to render the program non-free. 72 | 73 | The precise terms and conditions for copying, distribution and 74 | modification follow. 75 | 76 | ### TERMS AND CONDITIONS 77 | 78 | #### 0. Definitions. 79 | 80 | "This License" refers to version 3 of the GNU General Public License. 81 | 82 | "Copyright" also means copyright-like laws that apply to other kinds 83 | of works, such as semiconductor masks. 84 | 85 | "The Program" refers to any copyrightable work licensed under this 86 | License. Each licensee is addressed as "you". "Licensees" and 87 | "recipients" may be individuals or organizations. 88 | 89 | To "modify" a work means to copy from or adapt all or part of the work 90 | in a fashion requiring copyright permission, other than the making of 91 | an exact copy. The resulting work is called a "modified version" of 92 | the earlier work or a work "based on" the earlier work. 93 | 94 | A "covered work" means either the unmodified Program or a work based 95 | on the Program. 96 | 97 | To "propagate" a work means to do anything with it that, without 98 | permission, would make you directly or secondarily liable for 99 | infringement under applicable copyright law, except executing it on a 100 | computer or modifying a private copy. Propagation includes copying, 101 | distribution (with or without modification), making available to the 102 | public, and in some countries other activities as well. 103 | 104 | To "convey" a work means any kind of propagation that enables other 105 | parties to make or receive copies. Mere interaction with a user 106 | through a computer network, with no transfer of a copy, is not 107 | conveying. 108 | 109 | An interactive user interface displays "Appropriate Legal Notices" to 110 | the extent that it includes a convenient and prominently visible 111 | feature that (1) displays an appropriate copyright notice, and (2) 112 | tells the user that there is no warranty for the work (except to the 113 | extent that warranties are provided), that licensees may convey the 114 | work under this License, and how to view a copy of this License. If 115 | the interface presents a list of user commands or options, such as a 116 | menu, a prominent item in the list meets this criterion. 117 | 118 | #### 1. Source Code. 119 | 120 | The "source code" for a work means the preferred form of the work for 121 | making modifications to it. "Object code" means any non-source form of 122 | a work. 123 | 124 | A "Standard Interface" means an interface that either is an official 125 | standard defined by a recognized standards body, or, in the case of 126 | interfaces specified for a particular programming language, one that 127 | is widely used among developers working in that language. 128 | 129 | The "System Libraries" of an executable work include anything, other 130 | than the work as a whole, that (a) is included in the normal form of 131 | packaging a Major Component, but which is not part of that Major 132 | Component, and (b) serves only to enable use of the work with that 133 | Major Component, or to implement a Standard Interface for which an 134 | implementation is available to the public in source code form. A 135 | "Major Component", in this context, means a major essential component 136 | (kernel, window system, and so on) of the specific operating system 137 | (if any) on which the executable work runs, or a compiler used to 138 | produce the work, or an object code interpreter used to run it. 139 | 140 | The "Corresponding Source" for a work in object code form means all 141 | the source code needed to generate, install, and (for an executable 142 | work) run the object code and to modify the work, including scripts to 143 | control those activities. However, it does not include the work's 144 | System Libraries, or general-purpose tools or generally available free 145 | programs which are used unmodified in performing those activities but 146 | which are not part of the work. For example, Corresponding Source 147 | includes interface definition files associated with source files for 148 | the work, and the source code for shared libraries and dynamically 149 | linked subprograms that the work is specifically designed to require, 150 | such as by intimate data communication or control flow between those 151 | subprograms and other parts of the work. 152 | 153 | The Corresponding Source need not include anything that users can 154 | regenerate automatically from other parts of the Corresponding Source. 155 | 156 | The Corresponding Source for a work in source code form is that same 157 | work. 158 | 159 | #### 2. Basic Permissions. 160 | 161 | All rights granted under this License are granted for the term of 162 | copyright on the Program, and are irrevocable provided the stated 163 | conditions are met. This License explicitly affirms your unlimited 164 | permission to run the unmodified Program. The output from running a 165 | covered work is covered by this License only if the output, given its 166 | content, constitutes a covered work. This License acknowledges your 167 | rights of fair use or other equivalent, as provided by copyright law. 168 | 169 | You may make, run and propagate covered works that you do not convey, 170 | without conditions so long as your license otherwise remains in force. 171 | You may convey covered works to others for the sole purpose of having 172 | them make modifications exclusively for you, or provide you with 173 | facilities for running those works, provided that you comply with the 174 | terms of this License in conveying all material for which you do not 175 | control copyright. Those thus making or running the covered works for 176 | you must do so exclusively on your behalf, under your direction and 177 | control, on terms that prohibit them from making any copies of your 178 | copyrighted material outside their relationship with you. 179 | 180 | Conveying under any other circumstances is permitted solely under the 181 | conditions stated below. Sublicensing is not allowed; section 10 makes 182 | it unnecessary. 183 | 184 | #### 3. Protecting Users' Legal Rights From Anti-Circumvention Law. 185 | 186 | No covered work shall be deemed part of an effective technological 187 | measure under any applicable law fulfilling obligations under article 188 | 11 of the WIPO copyright treaty adopted on 20 December 1996, or 189 | similar laws prohibiting or restricting circumvention of such 190 | measures. 191 | 192 | When you convey a covered work, you waive any legal power to forbid 193 | circumvention of technological measures to the extent such 194 | circumvention is effected by exercising rights under this License with 195 | respect to the covered work, and you disclaim any intention to limit 196 | operation or modification of the work as a means of enforcing, against 197 | the work's users, your or third parties' legal rights to forbid 198 | circumvention of technological measures. 199 | 200 | #### 4. Conveying Verbatim Copies. 201 | 202 | You may convey verbatim copies of the Program's source code as you 203 | receive it, in any medium, provided that you conspicuously and 204 | appropriately publish on each copy an appropriate copyright notice; 205 | keep intact all notices stating that this License and any 206 | non-permissive terms added in accord with section 7 apply to the code; 207 | keep intact all notices of the absence of any warranty; and give all 208 | recipients a copy of this License along with the Program. 209 | 210 | You may charge any price or no price for each copy that you convey, 211 | and you may offer support or warranty protection for a fee. 212 | 213 | #### 5. Conveying Modified Source Versions. 214 | 215 | You may convey a work based on the Program, or the modifications to 216 | produce it from the Program, in the form of source code under the 217 | terms of section 4, provided that you also meet all of these 218 | conditions: 219 | 220 | - a) The work must carry prominent notices stating that you modified 221 | it, and giving a relevant date. 222 | - b) The work must carry prominent notices stating that it is 223 | released under this License and any conditions added under 224 | section 7. This requirement modifies the requirement in section 4 225 | to "keep intact all notices". 226 | - c) You must license the entire work, as a whole, under this 227 | License to anyone who comes into possession of a copy. This 228 | License will therefore apply, along with any applicable section 7 229 | additional terms, to the whole of the work, and all its parts, 230 | regardless of how they are packaged. This License gives no 231 | permission to license the work in any other way, but it does not 232 | invalidate such permission if you have separately received it. 233 | - d) If the work has interactive user interfaces, each must display 234 | Appropriate Legal Notices; however, if the Program has interactive 235 | interfaces that do not display Appropriate Legal Notices, your 236 | work need not make them do so. 237 | 238 | A compilation of a covered work with other separate and independent 239 | works, which are not by their nature extensions of the covered work, 240 | and which are not combined with it such as to form a larger program, 241 | in or on a volume of a storage or distribution medium, is called an 242 | "aggregate" if the compilation and its resulting copyright are not 243 | used to limit the access or legal rights of the compilation's users 244 | beyond what the individual works permit. Inclusion of a covered work 245 | in an aggregate does not cause this License to apply to the other 246 | parts of the aggregate. 247 | 248 | #### 6. Conveying Non-Source Forms. 249 | 250 | You may convey a covered work in object code form under the terms of 251 | sections 4 and 5, provided that you also convey the machine-readable 252 | Corresponding Source under the terms of this License, in one of these 253 | ways: 254 | 255 | - a) Convey the object code in, or embodied in, a physical product 256 | (including a physical distribution medium), accompanied by the 257 | Corresponding Source fixed on a durable physical medium 258 | customarily used for software interchange. 259 | - b) Convey the object code in, or embodied in, a physical product 260 | (including a physical distribution medium), accompanied by a 261 | written offer, valid for at least three years and valid for as 262 | long as you offer spare parts or customer support for that product 263 | model, to give anyone who possesses the object code either (1) a 264 | copy of the Corresponding Source for all the software in the 265 | product that is covered by this License, on a durable physical 266 | medium customarily used for software interchange, for a price no 267 | more than your reasonable cost of physically performing this 268 | conveying of source, or (2) access to copy the Corresponding 269 | Source from a network server at no charge. 270 | - c) Convey individual copies of the object code with a copy of the 271 | written offer to provide the Corresponding Source. This 272 | alternative is allowed only occasionally and noncommercially, and 273 | only if you received the object code with such an offer, in accord 274 | with subsection 6b. 275 | - d) Convey the object code by offering access from a designated 276 | place (gratis or for a charge), and offer equivalent access to the 277 | Corresponding Source in the same way through the same place at no 278 | further charge. You need not require recipients to copy the 279 | Corresponding Source along with the object code. If the place to 280 | copy the object code is a network server, the Corresponding Source 281 | may be on a different server (operated by you or a third party) 282 | that supports equivalent copying facilities, provided you maintain 283 | clear directions next to the object code saying where to find the 284 | Corresponding Source. Regardless of what server hosts the 285 | Corresponding Source, you remain obligated to ensure that it is 286 | available for as long as needed to satisfy these requirements. 287 | - e) Convey the object code using peer-to-peer transmission, 288 | provided you inform other peers where the object code and 289 | Corresponding Source of the work are being offered to the general 290 | public at no charge under subsection 6d. 291 | 292 | A separable portion of the object code, whose source code is excluded 293 | from the Corresponding Source as a System Library, need not be 294 | included in conveying the object code work. 295 | 296 | A "User Product" is either (1) a "consumer product", which means any 297 | tangible personal property which is normally used for personal, 298 | family, or household purposes, or (2) anything designed or sold for 299 | incorporation into a dwelling. In determining whether a product is a 300 | consumer product, doubtful cases shall be resolved in favor of 301 | coverage. For a particular product received by a particular user, 302 | "normally used" refers to a typical or common use of that class of 303 | product, regardless of the status of the particular user or of the way 304 | in which the particular user actually uses, or expects or is expected 305 | to use, the product. A product is a consumer product regardless of 306 | whether the product has substantial commercial, industrial or 307 | non-consumer uses, unless such uses represent the only significant 308 | mode of use of the product. 309 | 310 | "Installation Information" for a User Product means any methods, 311 | procedures, authorization keys, or other information required to 312 | install and execute modified versions of a covered work in that User 313 | Product from a modified version of its Corresponding Source. The 314 | information must suffice to ensure that the continued functioning of 315 | the modified object code is in no case prevented or interfered with 316 | solely because modification has been made. 317 | 318 | If you convey an object code work under this section in, or with, or 319 | specifically for use in, a User Product, and the conveying occurs as 320 | part of a transaction in which the right of possession and use of the 321 | User Product is transferred to the recipient in perpetuity or for a 322 | fixed term (regardless of how the transaction is characterized), the 323 | Corresponding Source conveyed under this section must be accompanied 324 | by the Installation Information. But this requirement does not apply 325 | if neither you nor any third party retains the ability to install 326 | modified object code on the User Product (for example, the work has 327 | been installed in ROM). 328 | 329 | The requirement to provide Installation Information does not include a 330 | requirement to continue to provide support service, warranty, or 331 | updates for a work that has been modified or installed by the 332 | recipient, or for the User Product in which it has been modified or 333 | installed. Access to a network may be denied when the modification 334 | itself materially and adversely affects the operation of the network 335 | or violates the rules and protocols for communication across the 336 | network. 337 | 338 | Corresponding Source conveyed, and Installation Information provided, 339 | in accord with this section must be in a format that is publicly 340 | documented (and with an implementation available to the public in 341 | source code form), and must require no special password or key for 342 | unpacking, reading or copying. 343 | 344 | #### 7. Additional Terms. 345 | 346 | "Additional permissions" are terms that supplement the terms of this 347 | License by making exceptions from one or more of its conditions. 348 | Additional permissions that are applicable to the entire Program shall 349 | be treated as though they were included in this License, to the extent 350 | that they are valid under applicable law. If additional permissions 351 | apply only to part of the Program, that part may be used separately 352 | under those permissions, but the entire Program remains governed by 353 | this License without regard to the additional permissions. 354 | 355 | When you convey a copy of a covered work, you may at your option 356 | remove any additional permissions from that copy, or from any part of 357 | it. (Additional permissions may be written to require their own 358 | removal in certain cases when you modify the work.) You may place 359 | additional permissions on material, added by you to a covered work, 360 | for which you have or can give appropriate copyright permission. 361 | 362 | Notwithstanding any other provision of this License, for material you 363 | add to a covered work, you may (if authorized by the copyright holders 364 | of that material) supplement the terms of this License with terms: 365 | 366 | - a) Disclaiming warranty or limiting liability differently from the 367 | terms of sections 15 and 16 of this License; or 368 | - b) Requiring preservation of specified reasonable legal notices or 369 | author attributions in that material or in the Appropriate Legal 370 | Notices displayed by works containing it; or 371 | - c) Prohibiting misrepresentation of the origin of that material, 372 | or requiring that modified versions of such material be marked in 373 | reasonable ways as different from the original version; or 374 | - d) Limiting the use for publicity purposes of names of licensors 375 | or authors of the material; or 376 | - e) Declining to grant rights under trademark law for use of some 377 | trade names, trademarks, or service marks; or 378 | - f) Requiring indemnification of licensors and authors of that 379 | material by anyone who conveys the material (or modified versions 380 | of it) with contractual assumptions of liability to the recipient, 381 | for any liability that these contractual assumptions directly 382 | impose on those licensors and authors. 383 | 384 | All other non-permissive additional terms are considered "further 385 | restrictions" within the meaning of section 10. If the Program as you 386 | received it, or any part of it, contains a notice stating that it is 387 | governed by this License along with a term that is a further 388 | restriction, you may remove that term. If a license document contains 389 | a further restriction but permits relicensing or conveying under this 390 | License, you may add to a covered work material governed by the terms 391 | of that license document, provided that the further restriction does 392 | not survive such relicensing or conveying. 393 | 394 | If you add terms to a covered work in accord with this section, you 395 | must place, in the relevant source files, a statement of the 396 | additional terms that apply to those files, or a notice indicating 397 | where to find the applicable terms. 398 | 399 | Additional terms, permissive or non-permissive, may be stated in the 400 | form of a separately written license, or stated as exceptions; the 401 | above requirements apply either way. 402 | 403 | #### 8. Termination. 404 | 405 | You may not propagate or modify a covered work except as expressly 406 | provided under this License. Any attempt otherwise to propagate or 407 | modify it is void, and will automatically terminate your rights under 408 | this License (including any patent licenses granted under the third 409 | paragraph of section 11). 410 | 411 | However, if you cease all violation of this License, then your license 412 | from a particular copyright holder is reinstated (a) provisionally, 413 | unless and until the copyright holder explicitly and finally 414 | terminates your license, and (b) permanently, if the copyright holder 415 | fails to notify you of the violation by some reasonable means prior to 416 | 60 days after the cessation. 417 | 418 | Moreover, your license from a particular copyright holder is 419 | reinstated permanently if the copyright holder notifies you of the 420 | violation by some reasonable means, this is the first time you have 421 | received notice of violation of this License (for any work) from that 422 | copyright holder, and you cure the violation prior to 30 days after 423 | your receipt of the notice. 424 | 425 | Termination of your rights under this section does not terminate the 426 | licenses of parties who have received copies or rights from you under 427 | this License. If your rights have been terminated and not permanently 428 | reinstated, you do not qualify to receive new licenses for the same 429 | material under section 10. 430 | 431 | #### 9. Acceptance Not Required for Having Copies. 432 | 433 | You are not required to accept this License in order to receive or run 434 | a copy of the Program. Ancillary propagation of a covered work 435 | occurring solely as a consequence of using peer-to-peer transmission 436 | to receive a copy likewise does not require acceptance. However, 437 | nothing other than this License grants you permission to propagate or 438 | modify any covered work. These actions infringe copyright if you do 439 | not accept this License. Therefore, by modifying or propagating a 440 | covered work, you indicate your acceptance of this License to do so. 441 | 442 | #### 10. Automatic Licensing of Downstream Recipients. 443 | 444 | Each time you convey a covered work, the recipient automatically 445 | receives a license from the original licensors, to run, modify and 446 | propagate that work, subject to this License. You are not responsible 447 | for enforcing compliance by third parties with this License. 448 | 449 | An "entity transaction" is a transaction transferring control of an 450 | organization, or substantially all assets of one, or subdividing an 451 | organization, or merging organizations. If propagation of a covered 452 | work results from an entity transaction, each party to that 453 | transaction who receives a copy of the work also receives whatever 454 | licenses to the work the party's predecessor in interest had or could 455 | give under the previous paragraph, plus a right to possession of the 456 | Corresponding Source of the work from the predecessor in interest, if 457 | the predecessor has it or can get it with reasonable efforts. 458 | 459 | You may not impose any further restrictions on the exercise of the 460 | rights granted or affirmed under this License. For example, you may 461 | not impose a license fee, royalty, or other charge for exercise of 462 | rights granted under this License, and you may not initiate litigation 463 | (including a cross-claim or counterclaim in a lawsuit) alleging that 464 | any patent claim is infringed by making, using, selling, offering for 465 | sale, or importing the Program or any portion of it. 466 | 467 | #### 11. Patents. 468 | 469 | A "contributor" is a copyright holder who authorizes use under this 470 | License of the Program or a work on which the Program is based. The 471 | work thus licensed is called the contributor's "contributor version". 472 | 473 | A contributor's "essential patent claims" are all patent claims owned 474 | or controlled by the contributor, whether already acquired or 475 | hereafter acquired, that would be infringed by some manner, permitted 476 | by this License, of making, using, or selling its contributor version, 477 | but do not include claims that would be infringed only as a 478 | consequence of further modification of the contributor version. For 479 | purposes of this definition, "control" includes the right to grant 480 | patent sublicenses in a manner consistent with the requirements of 481 | this License. 482 | 483 | Each contributor grants you a non-exclusive, worldwide, royalty-free 484 | patent license under the contributor's essential patent claims, to 485 | make, use, sell, offer for sale, import and otherwise run, modify and 486 | propagate the contents of its contributor version. 487 | 488 | In the following three paragraphs, a "patent license" is any express 489 | agreement or commitment, however denominated, not to enforce a patent 490 | (such as an express permission to practice a patent or covenant not to 491 | sue for patent infringement). To "grant" such a patent license to a 492 | party means to make such an agreement or commitment not to enforce a 493 | patent against the party. 494 | 495 | If you convey a covered work, knowingly relying on a patent license, 496 | and the Corresponding Source of the work is not available for anyone 497 | to copy, free of charge and under the terms of this License, through a 498 | publicly available network server or other readily accessible means, 499 | then you must either (1) cause the Corresponding Source to be so 500 | available, or (2) arrange to deprive yourself of the benefit of the 501 | patent license for this particular work, or (3) arrange, in a manner 502 | consistent with the requirements of this License, to extend the patent 503 | license to downstream recipients. "Knowingly relying" means you have 504 | actual knowledge that, but for the patent license, your conveying the 505 | covered work in a country, or your recipient's use of the covered work 506 | in a country, would infringe one or more identifiable patents in that 507 | country that you have reason to believe are valid. 508 | 509 | If, pursuant to or in connection with a single transaction or 510 | arrangement, you convey, or propagate by procuring conveyance of, a 511 | covered work, and grant a patent license to some of the parties 512 | receiving the covered work authorizing them to use, propagate, modify 513 | or convey a specific copy of the covered work, then the patent license 514 | you grant is automatically extended to all recipients of the covered 515 | work and works based on it. 516 | 517 | A patent license is "discriminatory" if it does not include within the 518 | scope of its coverage, prohibits the exercise of, or is conditioned on 519 | the non-exercise of one or more of the rights that are specifically 520 | granted under this License. You may not convey a covered work if you 521 | are a party to an arrangement with a third party that is in the 522 | business of distributing software, under which you make payment to the 523 | third party based on the extent of your activity of conveying the 524 | work, and under which the third party grants, to any of the parties 525 | who would receive the covered work from you, a discriminatory patent 526 | license (a) in connection with copies of the covered work conveyed by 527 | you (or copies made from those copies), or (b) primarily for and in 528 | connection with specific products or compilations that contain the 529 | covered work, unless you entered into that arrangement, or that patent 530 | license was granted, prior to 28 March 2007. 531 | 532 | Nothing in this License shall be construed as excluding or limiting 533 | any implied license or other defenses to infringement that may 534 | otherwise be available to you under applicable patent law. 535 | 536 | #### 12. No Surrender of Others' Freedom. 537 | 538 | If conditions are imposed on you (whether by court order, agreement or 539 | otherwise) that contradict the conditions of this License, they do not 540 | excuse you from the conditions of this License. If you cannot convey a 541 | covered work so as to satisfy simultaneously your obligations under 542 | this License and any other pertinent obligations, then as a 543 | consequence you may not convey it at all. For example, if you agree to 544 | terms that obligate you to collect a royalty for further conveying 545 | from those to whom you convey the Program, the only way you could 546 | satisfy both those terms and this License would be to refrain entirely 547 | from conveying the Program. 548 | 549 | #### 13. Use with the GNU Affero General Public License. 550 | 551 | Notwithstanding any other provision of this License, you have 552 | permission to link or combine any covered work with a work licensed 553 | under version 3 of the GNU Affero General Public License into a single 554 | combined work, and to convey the resulting work. The terms of this 555 | License will continue to apply to the part which is the covered work, 556 | but the special requirements of the GNU Affero General Public License, 557 | section 13, concerning interaction through a network will apply to the 558 | combination as such. 559 | 560 | #### 14. Revised Versions of this License. 561 | 562 | The Free Software Foundation may publish revised and/or new versions 563 | of the GNU General Public License from time to time. Such new versions 564 | will be similar in spirit to the present version, but may differ in 565 | detail to address new problems or concerns. 566 | 567 | Each version is given a distinguishing version number. If the Program 568 | specifies that a certain numbered version of the GNU General Public 569 | License "or any later version" applies to it, you have the option of 570 | following the terms and conditions either of that numbered version or 571 | of any later version published by the Free Software Foundation. If the 572 | Program does not specify a version number of the GNU General Public 573 | License, you may choose any version ever published by the Free 574 | Software Foundation. 575 | 576 | If the Program specifies that a proxy can decide which future versions 577 | of the GNU General Public License can be used, that proxy's public 578 | statement of acceptance of a version permanently authorizes you to 579 | choose that version for the Program. 580 | 581 | Later license versions may give you additional or different 582 | permissions. However, no additional obligations are imposed on any 583 | author or copyright holder as a result of your choosing to follow a 584 | later version. 585 | 586 | #### 15. Disclaimer of Warranty. 587 | 588 | THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY 589 | APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT 590 | HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT 591 | WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT 592 | LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR 593 | A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND 594 | PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE 595 | DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR 596 | CORRECTION. 597 | 598 | #### 16. Limitation of Liability. 599 | 600 | IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING 601 | WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR 602 | CONVEYS THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, 603 | INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES 604 | ARISING OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT 605 | NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR 606 | LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM 607 | TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH HOLDER OR OTHER 608 | PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. 609 | 610 | #### 17. Interpretation of Sections 15 and 16. 611 | 612 | If the disclaimer of warranty and limitation of liability provided 613 | above cannot be given local legal effect according to their terms, 614 | reviewing courts shall apply local law that most closely approximates 615 | an absolute waiver of all civil liability in connection with the 616 | Program, unless a warranty or assumption of liability accompanies a 617 | copy of the Program in return for a fee. 618 | 619 | END OF TERMS AND CONDITIONS 620 | 621 | ### How to Apply These Terms to Your New Programs 622 | 623 | If you develop a new program, and you want it to be of the greatest 624 | possible use to the public, the best way to achieve this is to make it 625 | free software which everyone can redistribute and change under these 626 | terms. 627 | 628 | To do so, attach the following notices to the program. It is safest to 629 | attach them to the start of each source file to most effectively state 630 | the exclusion of warranty; and each file should have at least the 631 | "copyright" line and a pointer to where the full notice is found. 632 | 633 | 634 | Copyright (C) 635 | 636 | This program is free software: you can redistribute it and/or modify 637 | it under the terms of the GNU General Public License as published by 638 | the Free Software Foundation, either version 3 of the License, or 639 | (at your option) any later version. 640 | 641 | This program is distributed in the hope that it will be useful, 642 | but WITHOUT ANY WARRANTY; without even the implied warranty of 643 | MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the 644 | GNU General Public License for more details. 645 | 646 | You should have received a copy of the GNU General Public License 647 | along with this program. If not, see . 648 | 649 | Also add information on how to contact you by electronic and paper 650 | mail. 651 | 652 | If the program does terminal interaction, make it output a short 653 | notice like this when it starts in an interactive mode: 654 | 655 | Copyright (C) 656 | This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'. 657 | This is free software, and you are welcome to redistribute it 658 | under certain conditions; type `show c' for details. 659 | 660 | The hypothetical commands \`show w' and \`show c' should show the 661 | appropriate parts of the General Public License. Of course, your 662 | program's commands might be different; for a GUI interface, you would 663 | use an "about box". 664 | 665 | You should also get your employer (if you work as a programmer) or 666 | school, if any, to sign a "copyright disclaimer" for the program, if 667 | necessary. For more information on this, and how to apply and follow 668 | the GNU GPL, see . 669 | 670 | The GNU General Public License does not permit incorporating your 671 | program into proprietary programs. If your program is a subroutine 672 | library, you may consider it more useful to permit linking proprietary 673 | applications with the library. If this is what you want to do, use the 674 | GNU Lesser General Public License instead of this License. But first, 675 | please read . 676 | 677 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 |

2 | Master 4 |

5 | 6 |

A collection of awesome lists, manuals, blogs, hacks, one-liners, cli/web tools and more.

7 | 8 |
9 | 10 |

11 | 12 | Branch 14 | 15 | 16 | License 18 | 19 |

20 | 21 |
22 | Created by 23 | trimstray and 24 | 25 | contributors 26 | 27 |
28 | 29 |
30 | 31 | *** 32 | 33 | ## :notebook_with_decorative_cover:  What is it? 34 | 35 | This list is a collection of various materials that I use every day in my work. It contains a lot of useful information gathered in one piece. 36 | 37 | ## :restroom:  For whom? 38 | 39 | It is intended for everyone and anyone - especially for System and Network Administrators, DevOps, Pentesters or Security Researchers. 40 | 41 | ## :information_source:  Contributing 42 | 43 | A few simple rules for this project: 44 | 45 | - inviting and clear 46 | - not tiring 47 | - useful 48 | 49 | These below rules may be better: 50 | 51 | - easy to contribute to (Markdown + HTML ...) 52 | - easy to find (simple TOC, maybe it's worth extending them?) 53 | 54 | Url marked **\*** is temporary unavailable. Please don't delete it without confirming that it has permanently expired. 55 | 56 | Before add pull request please see **[this](https://github.com/trimstray/the-book-of-secret-knowledge/blob/master/CONTRIBUTING.md)**. All **suggestions/PR** are welcome! 57 | 58 | ## :ballot_box_with_check:  Todo 59 | 60 | - [ ] Add useful shell functions 61 | - [ ] Add one-liners for collection tools (eg. CLI Tools) 62 | 63 | ## :anger:  Table of Contents 64 | 65 | Only main chapters: 66 | 67 | - **[CLI Tools](#cli-tools-toc)** 68 | - **[GUI Tools](#gui-tools-toc)** 69 | - **[Web Tools](#web-tools-toc)** 70 | - **[Systems/Services](#systemsservices-toc)** 71 | - **[Networks](#networks-toc)** 72 | - **[Manuals/Howtos/Tutorials](#manualshowtostutorials-toc)** 73 | - **[Awesome Lists](#awesome-lists-toc)** 74 | - **[Blogs](#blogs-toc)** 75 | - **[Hacking/Penetration Testing](#hackingpenetration-testing-toc)** 76 | - **[Your daily knowledge and news](#your-daily-knowledge-and-news-toc)** 77 | - **[Other Cheat Sheets](#other-cheat-sheets-toc)** 78 | - **[One-liners](#one-liners-toc)** 79 | 80 | ## :trident:  The Book of Secret Knowledge (Chapters) 81 | 82 | #### CLI Tools  [[TOC]](#anger-table-of-contents) 83 | 84 | ##### :black_small_square: Shells 85 | 86 |

87 |   :small_orange_diamond: Oh My ZSH! - the best framework for managing your Zsh configuration.
88 |   :small_orange_diamond: bash-it - framework for using, developing and maintaining shell scripts and custom commands for your daily work.
89 |   :small_orange_diamond: Oh My Fish - the Fishshell framework.
90 |

91 | 92 | ##### :black_small_square: Managers 93 | 94 |

95 |   :small_orange_diamond: Midnight Commander - visual file manager, licensed under GNU General Public License.
96 |   :small_orange_diamond: screen - full-screen window manager that multiplexes a physical terminal.
97 |   :small_orange_diamond: tmux - terminal multiplexer, lets you switch easily between several programs in one terminal.
98 |   :small_orange_diamond: tmux-cssh - sets a comfortable and easy to use functionality, clustering and synchronizing virtual tmux-sessions.
99 |

100 | 101 | ##### :black_small_square: Text editors 102 | 103 |

104 |   :small_orange_diamond: vi - is one of the most common text editors on Unix.
105 |   :small_orange_diamond: vim - is a highly configurable text editor.
106 |   :small_orange_diamond: emacs - an extensible, customizable, free/libre text editor - and more.
107 |

108 | 109 | ##### :black_small_square: Network 110 | 111 |

112 |   :small_orange_diamond: nmap - free and open source (license) utility for network discovery and security auditing.
113 |   :small_orange_diamond: masscan - the fastest Internet port scanner, spews SYN packets asynchronously.
114 |   :small_orange_diamond: pbscan - faster and more efficient stateless SYN scanner and banner grabber.
115 |   :small_orange_diamond: hping - command-line oriented TCP/IP packet assembler/analyzer.
116 |   :small_orange_diamond: mtr - functionality of the 'traceroute' and 'ping' programs in a single network diagnostic tool.
117 |   :small_orange_diamond: netcat - networking utility which reads and writes data across network connections, using the TCP/IP protocol.
118 |   :small_orange_diamond: tcpdump - powerful command-line packet analyzer.
119 |   :small_orange_diamond: tshark - dump and analyze network traffic (wireshark cli).
120 |   :small_orange_diamond: ngrep - is like GNU grep applied to the network layer.
121 |   :small_orange_diamond: bmon - monitoring and debugging tool to capture networking related statistics and prepare them visually.
122 |   :small_orange_diamond: iptraf-ng - is a console-based network monitoring program for Linux that displays information about IP traffic.
123 |   :small_orange_diamond: iPerf3 - is a tool for active measurements of the maximum achievable bandwidth on IP networks.
124 |   :small_orange_diamond: ethr - is a Network Performance Measurement Tool for TCP, UDP & HTTP.
125 |   :small_orange_diamond: Etherate - is a Linux CLI based Ethernet and MPLS traffic testing tool.
126 |   :small_orange_diamond: Nemesis - packet manipulation CLI tool; craft and inject packets of several protocols.
127 |   :small_orange_diamond: packetfu - a mid-level packet manipulation library for Ruby.
128 |   :small_orange_diamond: Scapy - packet manipulation library; forge, send, decode, capture packets of a wide number of protocols.
129 |   :small_orange_diamond: aria2 - is a lightweight multi-protocol & multi-source command-line download utility.
130 |

131 | 132 | ##### :black_small_square: Network (DNS) 133 | 134 |

135 |   :small_orange_diamond: fierce - a DNS reconnaissance tool for locating non-contiguous IP space.
136 |   :small_orange_diamond: sublist3r - fast subdomains enumeration tool for penetration testers.
137 |   :small_orange_diamond: amass - tool obtains subdomain names by scraping data sources, crawling web archives and more.
138 |   :small_orange_diamond: namebench - provides personalized DNS server recommendations based on your browsing history.
139 |

140 | 141 | 142 | ##### :black_small_square: Network (HTTP) 143 | 144 |

145 |   :small_orange_diamond: Curl - command line tool and library for transferring data with URLs.
146 |   :small_orange_diamond: kurly - is an alternative to the widely popular curl program, written in Golang.
147 |   :small_orange_diamond: HTTPie - a user-friendly HTTP client.
148 |   :small_orange_diamond: wuzz - interactive cli tool for HTTP inspection.
149 |   :small_orange_diamond: htrace.sh - shell script to debugging http/https; ssllabs, mozilla observatory, testssl.sh and nmap nse support.
150 |   :small_orange_diamond: httpstat - visualizes curl statistics in a way of beauty and clarity.
151 |   :small_orange_diamond: Lynx - is a text browser for the World Wide Web.
152 |   :small_orange_diamond: siege - is an http load testing and benchmarking utility.
153 |   :small_orange_diamond: wrk - is a modern HTTP benchmarking tool capable of generating significant load.
154 |   :small_orange_diamond: bombardier - fast cross-platform HTTP benchmarking tool written in Go.
155 |   :small_orange_diamond: gobench - http/https load testing and benchmarking tool.
156 |   :small_orange_diamond: gobuster - free and open source directory/file & DNS busting tool written in Go.
157 |

158 | 159 | ##### :black_small_square: SSL/Security 160 | 161 |

162 |   :small_orange_diamond: openssl - is a robust, commercial-grade, and full-featured toolkit for the TLS and SSL protocols.
163 |   :small_orange_diamond: gnutls-cli - client program to set up a TLS connection to some other computer.
164 |   :small_orange_diamond: sslyze 165 | - fast and powerful SSL/TLS server scanning library.
166 |   :small_orange_diamond: sslscan - tests SSL/TLS enabled services to discover supported cipher suites.
167 |   :small_orange_diamond: testssl.sh - testing TLS/SSL encryption anywhere on any port.
168 |   :small_orange_diamond: spiped - is a utility for creating symmetrically encrypted and authenticated pipes between socket addresses.
169 |   :small_orange_diamond: mkcert - simple zero-config tool to make locally trusted development certificates with any names you'd like.
170 |

171 | 172 | ##### :black_small_square: Auditing Tools 173 | 174 |

175 |   :small_orange_diamond: Lynis - battle-tested security tool for systems running Linux, macOS, or Unix-based operating system.
176 |   :small_orange_diamond: LinEnum - scripted Local Linux Enumeration & Privilege Escalation Checks.
177 |   :small_orange_diamond: Rkhunter - scanner tool for Linux systems that scans backdoors, rootkits and local exploits on your systems.
178 |   :small_orange_diamond: PE-sieve - is a light-weight tool that helps to detect malware running on the system.
179 |

180 | 181 | ##### :black_small_square: System Diagnostics/Debuggers 182 | 183 |

184 |   :small_orange_diamond: strace - diagnostic, debugging and instructional userspace utility for Linux.
185 |   :small_orange_diamond: DTrace - is a performance analysis and troubleshooting tool.
186 |   :small_orange_diamond: ltrace - is a library call tracer, used to trace calls made by programs to library functions.
187 |   :small_orange_diamond: sysdig - system exploration and troubleshooting tool with first class support for containers.
188 |   :small_orange_diamond: Valgrind - is an instrumentation framework for building dynamic analysis tools.
189 |   :small_orange_diamond: glances - cross-platform system monitoring tool written in Python.
190 |   :small_orange_diamond: htop - interactive text-mode process viewer for Unix systems. It aims to be a better 'top'.
191 |   :small_orange_diamond: atop - ASCII performance monitor. Includes statistics for CPU, memory, disk, swap, network, and processes.
192 |   :small_orange_diamond: lsof - displays in its output information about files that are opened by processes.
193 |   :small_orange_diamond: FlameGraph - stack trace visualizer.
194 |   :small_orange_diamond: lsofgraph - small utility to convert Unix lsof output to a graph showing FIFO and UNIX interprocess communication.
195 | 196 |

197 | 198 | ##### :black_small_square: Log Analyzers 199 | 200 |

201 |   :small_orange_diamond: GoAccess - real-time web log analyzer and interactive viewer that runs in a terminal.
202 |   :small_orange_diamond: ngxtop - real-time metrics for nginx server.
203 |

204 | 205 | ##### :black_small_square: Databases 206 | 207 |

208 |   :small_orange_diamond: usql - universal command-line interface for SQL databases.
209 |   :small_orange_diamond: pgcli - postgres CLI with autocompletion and syntax highlighting.
210 |   :small_orange_diamond: mycli - terminal client for MySQL with autocompletion and syntax highlighting.
211 |

212 | 213 | ##### :black_small_square: TOR 214 | 215 |

216 |   :small_orange_diamond: Nipe - script to make Tor Network your default gateway.
217 |   :small_orange_diamond: multitor - a tool that lets you create multiple TOR instances with a load-balancing.
218 |

219 | 220 | ##### :black_small_square: Other 221 | 222 |

223 |   :small_orange_diamond: incron - is an inode-based filesystem notification technology.
224 |   :small_orange_diamond: tldr - simplified and community-driven man pages.
225 |

226 | 227 | #### GUI Tools  [[TOC]](#anger-table-of-contents) 228 | 229 | ##### :black_small_square: Terminal emulators 230 | 231 |

232 |   :small_orange_diamond: Guake - is a dropdown terminal made for the GNOME desktop environment.
233 |   :small_orange_diamond: Terminator - is based on GNOME Terminal, useful features for sysadmins and other users.
234 |

235 | 236 | ##### :black_small_square: Network 237 | 238 |

239 |   :small_orange_diamond: Wireshark - is the world’s foremost and widely-used network protocol analyzer.
240 |

241 | 242 | ##### :black_small_square: Browsers 243 | 244 |

245 |   :small_orange_diamond: TOR Browser - protect your privacy and defend yourself against network surveillance and traffic analysis.
246 |

247 | 248 | ##### :black_small_square: Password Managers 249 | 250 |

251 |   :small_orange_diamond: KeePassXC - store your passwords safely and auto-type them into your everyday websites and apps.
252 |   :small_orange_diamond: Enpass - password manager and secure wallet.
253 |

254 | 255 | ##### :black_small_square: Messengers (end-to-end encryption) 256 | 257 |

258 |   :small_orange_diamond: Signal - is an encrypted communications app.
259 |   :small_orange_diamond: Wire - secure messaging, file sharing, voice calls and video conferences. All protected with end-to-end encryption.
260 |

261 | 262 | ##### :black_small_square: Text editors 263 | 264 |

265 |   :small_orange_diamond: Sublime Text - is a lightweight, cross-platform code editor known for its speed, ease of use.
266 |   :small_orange_diamond: Visual Studio Code - an open-source and free source code editor developed by Microsoft.
267 |   :small_orange_diamond: Atom - a hackable text editor for the 21st Century.
268 |

269 | 270 | #### Web Tools  [[TOC]](#anger-table-of-contents) 271 | 272 | ##### :black_small_square: Browsers 273 | 274 |

275 |   :small_orange_diamond: Can I use - provides up-to-date browser support tables for support of front-end web technologies.
276 |   :small_orange_diamond: Panopticlick 3.0 - is your browser safe against tracking?
277 |   :small_orange_diamond: Privacy Analyzer - see what data is exposed from your browser.
278 |   :small_orange_diamond: Web Browser Security - it's all about Web Browser fingerprinting.
279 |

280 | 281 | ##### :black_small_square: SSL/Security 282 | 283 |

284 |   :small_orange_diamond: SSL Server Test - free online service performs a deep analysis of the configuration of any SSL web server.
285 |   :small_orange_diamond: SSL Server Test (DEV) - free online service performs a deep analysis of the configuration of any SSL web server.
286 |   :small_orange_diamond: ImmuniWeb® SSLScan - test SSL/TLS (PCI DSS, HIPAA and NIST).
287 |   :small_orange_diamond: SSL Check - scan your website for non-secure content.
288 |   :small_orange_diamond: urlscan.io - service to scan and analyse websites.
289 |   :small_orange_diamond: Report URI - monitoring security policies like CSP and HPKP.
290 |   :small_orange_diamond: CSP Evaluator - allows developers and security experts to check if a Content Security Policy.
291 |   :small_orange_diamond: Useless CSP - public list about CSP in some big players (might make them care a bit more).
292 |   :small_orange_diamond: Why No HTTPS? - list of the world's top 100 websites by Alexa rank not automatically redirecting insecure requests.
293 |   :small_orange_diamond: cipherli.st - strong ciphers for Apache, Nginx, Lighttpd and more.
294 |   :small_orange_diamond: badssl.com - memorable site for testing clients against bad SSL configs.
295 |   :small_orange_diamond: tlsfun.de - registered for various tests regarding the TLS/SSL protocol.
296 |   :small_orange_diamond: Common CA Database - repository of information about CAs, and their root and intermediate certificates.
297 |   :small_orange_diamond: CERTSTREAM - real-time certificate transparency log update stream.
298 |   :small_orange_diamond: crt.sh - discovers certificates by continually monitoring all of the publicly known CT.
299 |

300 | 301 | ##### :black_small_square: HTTP Headers & Web Linters 302 | 303 |

304 |   :small_orange_diamond: Security Headers - analyse the HTTP response headers (with rating system to the results).
305 |   :small_orange_diamond: Observatory by Mozilla - set of tools to analyze your website.
306 |   :small_orange_diamond: webhint - is a linting tool that will help you with your site's accessibility, speed, security and more.
307 |

308 | 309 | ##### :black_small_square: DNS 310 | 311 |

312 |   :small_orange_diamond: ViewDNS - one source for free DNS related tools and information.
313 |   :small_orange_diamond: DNSlytics - online investigation tool.
314 |   :small_orange_diamond: DNS Spy - monitor, validate and verify your DNS configurations.
315 |   :small_orange_diamond: Find subdomains online - find subdomains for security assessment penetration test.
316 |   :small_orange_diamond: DNSdumpster - dns recon & research, find & lookup dns records.
317 |   :small_orange_diamond: DNS Table online - search for DNS records by domain, IP, CIDR, ISP.
318 |   :small_orange_diamond: PTRarchive.com - this site is responsible for the safekeeping of historical reverse DNS records.
319 |   :small_orange_diamond: xip.ip - wildcard DNS for everyone.
320 |   :small_orange_diamond: intoDNS - DNS and mail server health checker.
321 |   :small_orange_diamond: Leaf DNS - comprehensive DNS tester.
322 |   :small_orange_diamond: dnslookup (ceipam) - one of the best DNS propagation checker (and not only).
323 |   :small_orange_diamond: What's My DNS - DNS propagation checking tool.
324 | 325 |

326 | 327 | ##### :black_small_square: Mail 328 | 329 |

330 |   :small_orange_diamond: MX Toolbox - all of your MX record, DNS, blacklist and SMTP diagnostics in one integrated tool.
331 |   :small_orange_diamond: blacklistalert - checks to see if your domain is on a Real Time Spam Blacklist.
332 |   :small_orange_diamond: MultiRBL - complete IP check for sending Mailservers.
333 |   :small_orange_diamond: DKIM SPF & Spam Assassin Validator - checks mail authentication and scores messages with Spam Assassin.
334 |

335 | 336 | ##### :black_small_square: Net-tools 337 | 338 |

339 |   :small_orange_diamond: Netcraft - detailed report about the site, helping you to make informed choices about their integrity.
340 |   :small_orange_diamond: RIPE NCC - not-for-profit membership association, a Regional Internet Registry and the secretariat for the RIPE.
341 |   :small_orange_diamond: Robtex - uses various sources to gather public information about IP numbers, domain names, host names, routes etc.
342 |   :small_orange_diamond: Security Trails - APIs for Security Companies, Researchers and Teams.
343 |   :small_orange_diamond: Online Curl - curl test, analyze HTTP Response Headers.
344 |   :small_orange_diamond: Ping.eu - online Ping, Traceroute, DNS lookup, WHOIS and others.
345 |   :small_orange_diamond: Network-Tools - network tools for webmasters, IT technicians & geeks.
346 |   :small_orange_diamond: URL Encode/Decode - tool from above to either encode or decode a string of text.
347 |   :small_orange_diamond: Uncoder - the online translator for search queries on log data.
348 |   :small_orange_diamond: Regex101 - online regex tester and debugger: PHP, PCRE, Python, Golang and JavaScript.
349 |   :small_orange_diamond: RegExr - online tool to learn, build, & test Regular Expressions (RegEx / RegExp).
350 |   :small_orange_diamond: Hardenize - deploy the security standards.
351 |   :small_orange_diamond: VirusTotal - analyze suspicious files and URLs to detect types of malware.
352 |

353 | 354 | ##### :black_small_square: Privacy 355 | 356 |

357 |   :small_orange_diamond: privacytools.io - provides knowledge and tools to protect your privacy against global mass surveillance.
358 |   :small_orange_diamond: DNS Privacy Test Servers - DNS privacy recursive servers list (with a 'no logging' policy).
359 |

360 | 361 | ##### :black_small_square: Code parsers/playgrounds 362 | 363 |

364 |   :small_orange_diamond: ShellCheck - finds bugs in your shell scripts.
365 |   :small_orange_diamond: explainshell - get interactive help texts for shell commands.
366 |   :small_orange_diamond: jsbin - live pastebin for HTML, CSS & JavaScript and more.
367 |   :small_orange_diamond: CodePen - a social development environment for front-end designers and developers.
368 |   :small_orange_diamond: CodeSandbox - online code editor for web application development. Supports React, Vue, Angular, CxJS, Dojo, etc.
369 |   :small_orange_diamond: PHP Sandbox - test your PHP code with this code tester.
370 |   :small_orange_diamond: Repl.it - an instant IDE to learn, build, collaborate, and host all in one place.
371 |

372 | 373 | ##### :black_small_square: Performance 374 | 375 |

376 |   :small_orange_diamond: GTmetrix - analyze your site’s speed and make it faster.
377 |   :small_orange_diamond: Sucuri loadtimetester - test here the 378 | performance of any of your sites from across the globe.
379 |   :small_orange_diamond: Pingdom Tools - analyze your site’s speed around the world.
380 |   :small_orange_diamond: PingMe.io - run website latency tests across multiple geographic regions.
381 |   :small_orange_diamond: PageSpeed Insights - analyze your site’s speed and make it faster.
382 |   :small_orange_diamond: web.dev - helps developers like you learn and apply the web's modern capabilities to your own sites and apps.
383 |

384 | 385 | ##### :black_small_square: Mass scanners (search engines) 386 | 387 |

388 |   :small_orange_diamond: Censys - platform that helps information security practitioners discover, monitor, and analyze devices.
389 |   :small_orange_diamond: Shodan - the world's first search engine for Internet-connected devices.
390 |   :small_orange_diamond: Shodan 2000 - do you use Shodan for everyday work? This tool looks for randomly generated data from Shodan.
391 |   :small_orange_diamond: GreyNoise - mass scanner such as Shodan and Censys.
392 |   :small_orange_diamond: ZoomEye - search engine for cyberspace that lets the user find specific network components.
393 |   :small_orange_diamond: FOFA - is a cyberspace search engine.
394 |   :small_orange_diamond: onyphe - is a search engine for open-source and cyber threat intelligence data collected.
395 |   :small_orange_diamond: binaryedge - it scan the entire internet space and create real-time threat intelligence streams and reports.
396 |   :small_orange_diamond: hunter - lets you find email addresses in seconds and connect with the people that matter for your business.
397 |   :small_orange_diamond: wigle - is a submission-based catalog of wireless networks. All the networks. Found by Everyone.
398 |   :small_orange_diamond: PublicWWW - find any alphanumeric snippet, signature or keyword in the web pages HTML, JS and CSS code.
399 |   :small_orange_diamond: IntelTechniques - this repository contains hundreds of online search utilities.
400 |   :small_orange_diamond: GhostProject? - search by full email address or username.
401 |   :small_orange_diamond: Buckets by Grayhatwarfar - database with public search for Open Amazon S3 Buckets and their contents.
402 |   :small_orange_diamond: Vigilante.pw - the breached database directory.
403 |   :small_orange_diamond: builtwith - find out what websites are built with.
404 |   :small_orange_diamond: Mamont's open FTP Index - if a target has an open FTP site with accessible content it will be listed here.
405 |

406 | 407 | ##### :black_small_square: Passwords 408 | 409 |

410 |   :small_orange_diamond: Gotcha? - list of 1.4 billion accounts circulates around the Internet.
411 |   :small_orange_diamond: have i been pwned? - check if you have an account that has been compromised in a data breach.
412 |

413 | 414 | ##### :black_small_square: CVE/Exploits databases 415 | 416 |

417 |   :small_orange_diamond: CVE Mitre - list of publicly known cybersecurity vulnerabilities.
418 |   :small_orange_diamond: CVE Details - CVE security vulnerability advanced database.
419 |   :small_orange_diamond: Exploit DB - CVE compliant archive of public exploits and corresponding vulnerable software.
420 |   :small_orange_diamond: 0day.today - exploits market provides you the possibility to buy zero-day exploits and also to sell 0day exploits.
421 |   :small_orange_diamond: sploitus - the exploit and tools database.
422 |   :small_orange_diamond: cxsecurity - free vulnerability database.
423 |

424 | 425 | ##### :black_small_square: Mobile apps scanners 426 | 427 |

428 |   :small_orange_diamond: ImmuniWeb® Mobile App Scanner - test security and privacy of mobile apps (iOS & Android).
429 |   :small_orange_diamond: Quixxi - free Mobile App Vulnerability Scanner for Android & iOS.
430 |   :small_orange_diamond: Ostorlab - analyzes mobile application to identify vulnerabilities and potential weaknesses.
431 |

432 | 433 | ##### :black_small_square: Private Search Engines 434 | 435 |

436 |   :small_orange_diamond: Startpage - the world's most private search engine.
437 |   :small_orange_diamond: searX - a privacy-respecting, hackable metasearch engine.
438 |

439 | 440 | ##### :black_small_square: Secure WebMail Providers 441 | 442 |

443 |   :small_orange_diamond: CounterMail - is a secure and easy to use online email service, designed to provide maximum security and privacy.
444 |   :small_orange_diamond: Mail2Tor - is a Tor Hidden Service that allows anyone to send and receive emails anonymously.
445 |   :small_orange_diamond: Tutanota - is the world's most secure email service and amazingly easy to use.
446 |   :small_orange_diamond: Protonmail - is the world's largest secure email service, developed by CERN and MIT scientists.
447 |   :small_orange_diamond: Startmail - private & encrypted email made easy.
448 |

449 | 450 | ##### :black_small_square: Crypto 451 | 452 |

453 |   :small_orange_diamond: Keybase - it's open source and powered by public-key cryptography.
454 |

455 | 456 | ##### :black_small_square: PGP Keyservers 457 | 458 |

459 |   :small_orange_diamond: SKS OpenPGP Key server - includes a highly-efficient reconciliation algorithm for keeping the keyservers synchronized.
460 |

461 | 462 | #### Systems/Services  [[TOC]](#anger-table-of-contents) 463 | 464 | ##### :black_small_square: Operating Systems 465 | 466 |

467 |   :small_orange_diamond: Slackware - the most "Unix-like" Linux distribution.
468 |   :small_orange_diamond: OpenBSD - multi-platform 4.4BSD-based UNIX-like operating system.
469 |   :small_orange_diamond: HardenedBSD - HardenedBSD aims to implement innovative exploit mitigation and security solutions.
470 |   :small_orange_diamond: Kali Linux - Linux distribution used for Penetration Testing, Ethical Hacking and network security assessments.
471 |   :small_orange_diamond: Backbox Linux - penetration test and security assessment oriented Ubuntu-based Linux distribution.
472 |

473 | 474 | ##### :black_small_square: HTTP(s) Services 475 | 476 |

477 |   :small_orange_diamond: Varnish Cache - HTTP accelerator designed for content-heavy dynamic web sites.
478 |   :small_orange_diamond: Nginx - open source web and reverse proxy server that is similar to Apache, but very light weight.
479 |   :small_orange_diamond: HAProxy - the reliable, high performance TCP/HTTP load balancer.
480 |

481 | 482 | ##### :black_small_square: Security/hardening 483 | 484 |

485 |   :small_orange_diamond: Emerald Onion - seattle-based encrypted-transit internet service provider.
486 |   :small_orange_diamond: Unbound - validating, recursive, and caching DNS resolver (with TLS).
487 |   :small_orange_diamond: Knot Resolver - caching full resolver implementation, including both a resolver library and a daemon.
488 |   :small_orange_diamond: pi-hole - the Pi-hole® is a DNS sinkhole that protects your devices from unwanted content.
489 |

490 | 491 | #### Networks  [[TOC]](#anger-table-of-contents) 492 | 493 | ##### :black_small_square: Tools 494 | 495 |

496 |   :small_orange_diamond: CapAnalysis - web visual tool to analyze large amounts of captured network traffic (PCAP analyzer).
497 |

498 | 499 | ##### :black_small_square: Labs 500 | 501 |

502 |   :small_orange_diamond: NRE Labs - learn automation by doing it. Right now, right here, in your browser.
503 |

504 | 505 | #### Manuals/Howtos/Tutorials  [[TOC]](#anger-table-of-contents) 506 | 507 | ##### :black_small_square: Bash 508 | 509 |

510 |   :small_orange_diamond: pure-bash-bible - a collection of pure bash alternatives to external processes.
511 |   :small_orange_diamond: The Bash Hackers Wiki - hold documentation of any kind about GNU Bash.
512 |   :small_orange_diamond: Shell & Utilities - describes the commands and utilities offered to application programs by POSIX-conformant systems.
513 |

514 | 515 | ##### :black_small_square: Python 516 | 517 |

518 |   :small_orange_diamond: Awesome Python - a curated list of awesome Python frameworks, libraries, software and resources.
519 |

520 | 521 | ##### :black_small_square: Sed & Awk & Other 522 | 523 |

524 |   :small_orange_diamond: F’Awk Yeah! - advanced sed and awk usage (Parsing for Pentesters 3).
525 |

526 | 527 | ##### :black_small_square: \*nix & Network 528 | 529 |

530 |   :small_orange_diamond: nixCraft - linux and unix tutorials for new and seasoned sysadmin.
531 |   :small_orange_diamond: TecMint - the ideal Linux blog for Sysadmins & Geeks.
532 |   :small_orange_diamond: Omnisecu - free Networking, System Administration and Security tutorials.
533 |   :small_orange_diamond: Unix Toolbox - collection of Unix/Linux/BSD commands and tasks which are useful for IT work or for advanced users.
534 |   :small_orange_diamond: Linux Guide and Hints - tutorials on system administration in Fedora® and CentOS®, including OpenLDAP and FreeIPA.
535 |   :small_orange_diamond: http2-explained - a detailed document explaining and documenting HTTP/2.
536 |   :small_orange_diamond: http3-explained - a document describing the HTTP/3 and QUIC protocols.
537 |

538 | 539 | ##### :black_small_square: System hardening 540 | 541 |

542 |   :small_orange_diamond: Security Harden CentOS 7 - this walks you through the steps required to security harden CentOS.
543 |   :small_orange_diamond: CentOS 7 Server Hardening Guide - great guide for hardening CentOS; familiar with OpenSCAP.
544 |

545 | 546 | ##### :black_small_square: Security & Privacy 547 | 548 |

549 |   :small_orange_diamond: OWASP - worldwide not-for-profit charitable organization focused on improving the security of software.
550 |   :small_orange_diamond: OWASP ASVS 3.0.1 - OWASP Application Security Verification Standard Project.
551 |   :small_orange_diamond: OWASP ASVS 3.0.1 Web App - simple web app that helps developers understand the ASVS requirements.
552 |   :small_orange_diamond: OWASP Testing Guide v4 - includes a "best practice" penetration testing framework.
553 |   :small_orange_diamond: Hacking Articles - LRaj Chandel's Security & Hacking Blog.
554 |   :small_orange_diamond: AWS security tools - make your AWS cloud environment more secure.
555 |   :small_orange_diamond: Rawsec's CyberSecurity Inventory - an inventory of tools and resources about CyberSecurity.
556 |   :small_orange_diamond: Application Security Wiki - is an initiative to provide all application security related resources at one place.
557 |   :small_orange_diamond: The Illustrated TLS Connection - every byte of a TLS connection explained and reproduced.
558 |   :small_orange_diamond: Certificates and PKI - everything you should know about certificates and PKI but are too afraid to ask.
559 |   :small_orange_diamond: The Art of Subdomain Enumeration - a reference for subdomain enumeration techniques.
560 |   :small_orange_diamond: Quitting Google - the comprehensive guide to quitting Google.
561 |

562 | 563 | ##### :black_small_square: Web Apps 564 | 565 |

566 |   :small_orange_diamond: Mozilla Web Security - help operational teams with creating secure web applications.
567 |   :small_orange_diamond: Enable CORS - enable cross-origin resource sharing.
568 |

569 | 570 | ##### :black_small_square: Other 571 | 572 |

573 |   :small_orange_diamond: CTF Series : Vulnerable Machines - the steps below could be followed to find vulnerabilities and exploits.
574 |   :small_orange_diamond: How to start RE/malware analysis? - collection of some hints and useful links for the beginners.
575 |   :small_orange_diamond: LZone Cheat Sheets - all cheat sheets.
576 |   :small_orange_diamond: Dan’s Cheat Sheets’s - massive cheat sheets documentation.
577 |   :small_orange_diamond: The C10K problem - it's time for web servers to handle ten thousand clients simultaneously, don't you think?
578 |   :small_orange_diamond: Bank Grade Security - when companies say they have "Bank Grade Security" they imply that it is a good thing.*
579 |   :small_orange_diamond: HTTPS on Stack Overflow - this is the story of a long journey regarding the implementation of SSL.
580 |   :small_orange_diamond: Julia's Drawings - some drawings about programming and unix world, zines about systems & debugging tools.
581 |   :small_orange_diamond: DEF CON Media Server - great stuff from DEFCON 26.
582 |   :small_orange_diamond: BGP Meets Cat - after 3072 hours of manipulating BGP, Job Snijders has succeeded in drawing a Nyancat.
583 |   :small_orange_diamond: HTTPS in the real world - great tutorial explain how HTTPS works in the real world.
584 |   :small_orange_diamond: Gitlab and NFS bug - how we spent two weeks hunting an NFS bug in the Linux kernel.
585 |   :small_orange_diamond: Hidden directories and files - as a source of sensitive information about web application.
586 |   :small_orange_diamond: How To Become A Hacker - if you want to be a hacker, keep reading.
587 |   :small_orange_diamond: Operation Costs in CPU - an infographics which should help to estimate costs of certain operations in CPU clocks.
588 |

589 | 590 | #### Awesome Lists  [[TOC]](#anger-table-of-contents) 591 | 592 | ##### :black_small_square: SysOps/DevOps 593 | 594 |

595 |   :small_orange_diamond: Awesome Sysadmin - amazingly awesome open source sysadmin resources.
596 |   :small_orange_diamond: Awesome Shell - awesome command-line frameworks, toolkits, guides and gizmos.
597 |   :small_orange_diamond: Command-line-text-processing - from finding text to search and replace, from sorting to beautifying text and more.
598 |   :small_orange_diamond: Awesome Pcaptools - collection of tools developed by other researchers to process network traces.
599 |   :small_orange_diamond: Linux Network Performance - learn where some of the network sysctl variables fit into the Linux/Kernel network flow.
600 |   :small_orange_diamond: Awesome Scalability - best practices in building High Scalability, High Availability, High Stability and more.
601 |   :small_orange_diamond: Awesome Postgres - list of awesome PostgreSQL software, libraries, tools and resources.
602 |   :small_orange_diamond: Awesome-Selfhosted - list of Free Software network services and web applications which can be hosted locally.
603 |

604 | 605 | ##### :black_small_square: Security/Pentesting 606 | 607 |

608 |   :small_orange_diamond: Awesome Web Security - curated list of Web Security materials and resources.
609 |   :small_orange_diamond: Red-Teaming-Toolkit - a collection of open source and commercial tools that aid in red team operations.
610 |   :small_orange_diamond: Free Security eBooks - list of a Free Security and Hacking eBooks.
611 |   :small_orange_diamond: Movies for Hackers - list of movies every hacker & cyberpunk must watch.
612 |

613 | 614 | #### Blogs  [[TOC]](#anger-table-of-contents) 615 | 616 | ##### :black_small_square: Geeky Persons 617 | 618 |

619 |   :small_orange_diamond: Brendan Gregg's Blog - Brendan Gregg is an industry expert in computing performance and cloud computing.
620 |   :small_orange_diamond: Gynvael "GynDream" Coldwind - Gynvael is a IT security engineer at Google.
621 |   :small_orange_diamond: Michał "lcamtuf" Zalewski - "white hat" hacker, computer security expert.
622 |   :small_orange_diamond: Mattias Geniar - developer, Sysadmin, Blogger, Podcaster and Public Speaker.
623 |   :small_orange_diamond: Nick Craver - Software Developer and Systems Administrator for Stack Exchange.
624 |   :small_orange_diamond: Robert Penz - IT security Expert.
625 |   :small_orange_diamond: Scott Helme - Security Researcher, international speaker and founder of securityheaders.com and report-uri.com.
626 |   :small_orange_diamond: Binni Shah - Linux Evangelist. Malwares. Kernel Dev. Security Enthusiast.
627 |   :small_orange_diamond: Kacper Szurek - Detection Engineer at ESET.
628 |   :small_orange_diamond: Troy Hunt - Microsoft Regional Director and Microsoft Most Valuable Professional for Developer Security.
629 |   :small_orange_diamond: raymii.org - Linux/Unix Sysadmin specializing in building high availability cloud environments.
630 |

631 | 632 | ##### :black_small_square: Geeky Blogs 633 | 634 |

635 |   :small_orange_diamond: Linux Audit - the Linux security blog about Auditing, Hardening and Compliance by Michael Boelen.
636 |   :small_orange_diamond: 637 | Linux Security Expert - trainings, howtos, checklists, security tools and more.
638 |   :small_orange_diamond: The Grymoire - collection of useful incantations for wizards, be you computer wizards, magicians, or whatever.
639 |

640 | 641 | ##### :black_small_square: A piece of history 642 | 643 |

644 |   :small_orange_diamond: How to Do Things at ARL - how to configure modems, scan images, record CD-ROMs, and other useful techniques.
645 |

646 | 647 | #### Hacking/Penetration Testing  [[TOC]](#anger-table-of-contents) 648 | 649 | ##### :black_small_square: Pentesters arsenal tools 650 | 651 |

652 |   :small_orange_diamond: Sandcat Browser - a penetration-oriented browser with plenty of advanced functionality already built in.
653 |   :small_orange_diamond: Metasploit - tool and framework for pentesting system, web and many more, contains a lot a ready to use exploit.
654 |   :small_orange_diamond: Burp Suite - tool for testing Web application security, intercepting proxy to replay, inject, scan and fuzz HTTP requests.
655 |   :small_orange_diamond: OWASP Zed Attack Proxy - intercepting proxy to replay, inject, scan and fuzz HTTP requests.
656 |   :small_orange_diamond: w3af - is a Web Application Attack and Audit Framework.
657 |   :small_orange_diamond: Nikto2 - web server scanner which performs comprehensive tests against web servers for multiple items.
658 |   :small_orange_diamond: sqlmap - tool that automates the process of detecting and exploiting SQL injection flaws.
659 |   :small_orange_diamond: Faraday - an Integrated Multiuser Pentest Environment.
660 |   :small_orange_diamond: ctf-tools - some setup scripts for security research tools.
661 |   :small_orange_diamond: security-tools - collection of small security tools created mostly in Python. CTFs, pentests and so on.
662 |   :small_orange_diamond: fuzzdb - dictionary of attack patterns and primitives for black-box application fault injection and resource discovery.
663 |   :small_orange_diamond: GDB PEDA - Python Exploit Development Assistance for GDB.
664 |   :small_orange_diamond: IDA - multi-processor disassembler and debugger useful for reverse engineering malware.
665 |   :small_orange_diamond: radare2 - framework for reverse-engineering and analyzing binaries.
666 |   :small_orange_diamond: Vulnreport - open-source pentesting management and automation platform by Salesforce Product Security.
667 |

668 | 669 | ##### :black_small_square: Pentests bookmarks collection 670 | 671 |

672 |   :small_orange_diamond: PTES - the penetration testing execution standard.
673 |   :small_orange_diamond: Pentests MindMap - amazing mind map with vulnerable apps and systems.
674 |   :small_orange_diamond: WebApps Security Tests MindMap - incredible mind map for WebApps security tests.
675 |   :small_orange_diamond: Brute XSS - master the art of Cross Site Scripting.
676 |   :small_orange_diamond: Offensive Security Bookmarks - security bookmarks collection, all that things I need to pass OSCP.
677 |   :small_orange_diamond: SecLists - collection of multiple types of lists used during security assessments, collected in one place.
678 |   :small_orange_diamond: Awesome Pentest Cheat Sheets - collection of the cheat sheets useful for pentesting.
679 |   :small_orange_diamond: Awesome Hacking by HackWithGithub - awesome lists for hackers, pentesters and security researchers.
680 |   :small_orange_diamond: Awesome Hacking by carpedm20 - a curated list of awesome hacking tutorials, tools and resources.
681 |   :small_orange_diamond: Awesome Hacking Resources - collection of hacking/penetration testing resources to make you better.
682 |   :small_orange_diamond: Awesome Pentest - collection of awesome penetration testing resources, tools and other shiny things.
683 |   :small_orange_diamond: Hacking Cheat Sheet - author hacking and pentesting notes.
684 |   :small_orange_diamond: Cyber Security Resources - includes thousands of cybersecurity-related references and resources.
685 |   :small_orange_diamond: Pentest Bookmarks - there are a LOT of pentesting blogs.
686 |   :small_orange_diamond: PayloadsAllTheThings - a list of useful payloads and bypass for Web Application Security and Pentest/CTF.
687 |   :small_orange_diamond: Pentesting Tools Cheat Sheet - a quick reference high level overview for typical penetration testing engagements.
688 |   :small_orange_diamond: Awesome Malware Analysis - a curated list of awesome malware analysis tools and resources.
689 |   :small_orange_diamond: SQL Injection Cheat Sheet - detailed technical information about the many different variants of the SQL Injection.
690 |   :small_orange_diamond: Entersoft Knowledge Base - great and detailed reference about vulnerabilities.
691 |   :small_orange_diamond: HTML5 Security Cheatsheet - a collection of HTML5 related XSS attack vectors.
692 |   :small_orange_diamond: XSS String Encoder - for generating XSS code to check your input validation filters against XSS.
693 |   :small_orange_diamond: GTFOBins - list of Unix binaries that can be exploited by an attacker to bypass local security restrictions.
694 |   :small_orange_diamond: Guifre Ruiz Notes - collection of security, system, network and pentest cheatsheets.
695 |   :small_orange_diamond: SSRF Tips - a collection of SSRF Tips.
696 |   :small_orange_diamond: shell-storm repo CTF - great archive of CTFs.
697 |

698 | 699 | ##### :black_small_square: Bounty programs 700 | 701 |

702 |   :small_orange_diamond: Bounty Factory - European bug bounty platform based on the legislation and rules in force in European countries.
703 |   :small_orange_diamond: Openbugbounty - allows any security researcher reporting a vulnerability on any website.
704 |   :small_orange_diamond: hackerone - global hacker community to surface the most relevant security issues.
705 |   :small_orange_diamond: bugcrowd - crowdsourced cybersecurity for the enterprise.
706 |   :small_orange_diamond: Crowdshield - crowdsourced Security & Bug Bounty Management.
707 |

708 | 709 | ##### :black_small_square: Web Training Apps (local installation) 710 | 711 |

712 |   :small_orange_diamond: OWASP-VWAD - comprehensive and well maintained registry of all known vulnerable web applications.
713 |   :small_orange_diamond: Metasploitable 2 - vulnerable web application amongst security researchers.
714 |   :small_orange_diamond: DVWA - PHP/MySQL web application that is damn vulnerable.
715 |   :small_orange_diamond: OWASP Mutillidae II - free, open source, deliberately vulnerable web-application.
716 |   :small_orange_diamond: OWASP Juice Shop Project - the most bug-free vulnerable application in existence.
717 |   :small_orange_diamond: OWASP WebGoat Project - insecure web application maintained by OWASP designed to teach web app security.
718 |   :small_orange_diamond: Security Ninjas - open source application security training program.
719 |   :small_orange_diamond: hackazon - a modern vulnerable web app.
720 |   :small_orange_diamond: dvna - damn vulnerable NodeJS application.
721 |   :small_orange_diamond: Google Gruyere - web application exploits and defenses.
722 |   :small_orange_diamond: Bodhi - is a playground focused on learning the exploitation of client-side web vulnerabilities.
723 |

724 | 725 | ##### :black_small_square: Labs (ethical hacking platforms/trainings/CTFs) 726 | 727 |

728 |   :small_orange_diamond: Offensive Security - true performance-based penetration testing training for over a decade.
729 |   :small_orange_diamond: Hack The Box - online platform allowing you to test your penetration testing skills.
730 |   :small_orange_diamond: Hacking-Lab - online ethical hacking, computer network and security challenge platform.
731 |   :small_orange_diamond: pwnable.kr - non-commercial wargame site which provides various pwn challenges regarding system exploitation.
732 |   :small_orange_diamond: Pwnable.tw - is a wargame site for hackers to test and expand their binary exploiting skills.
733 |   :small_orange_diamond: picoCTF - is a free computer security game targeted at middle and high school students.
734 |   :small_orange_diamond: CTFlearn - is an online platform built to help ethical hackers learn and practice their cybersecurity knowledge and skills.
735 |   :small_orange_diamond: Silesia Security Lab - high quality security testing services.
736 |   :small_orange_diamond: Practical Pentest Labs - pentest lab, take your Hacking skills to the next level.
737 |   :small_orange_diamond: Root Me - the fast, easy, and affordable way to train your hacking skills.
738 |   :small_orange_diamond: rozwal.to - a great platform to train your pentesting skills.
739 |   :small_orange_diamond: TryHackMe - learning Cyber Security made easy.
740 |   :small_orange_diamond: hackxor - is a realistic web application hacking game, designed to help players of all abilities develop their skills.
741 |   :small_orange_diamond: OverTheWire - can help you to learn and practice security concepts in the form of fun-filled games.
742 |   :small_orange_diamond: Wizard Labs - is an online Penetration Testing Lab.
743 |   :small_orange_diamond: PentesterLab - provides vulnerable systems that can be used to test and understand vulnerabilities.
744 |   :small_orange_diamond: RingZer0 - tons of challenges designed to test and improve your hacking skills.
745 |   :small_orange_diamond: Ubeeri - preconfigured lab environments.
746 |   :small_orange_diamond: Pentestit - emulate IT infrastructures of real companies for legal pen testing and improving penetration testing skills.
747 |   :small_orange_diamond: Microcorruption - reversal challenges done in the web interface.
748 |   :small_orange_diamond: Crackmes - download crackmes to help improve your reverse engineering skills.
749 |

750 | 751 | ##### :black_small_square: Other resources 752 | 753 |

754 |   :small_orange_diamond: Bugcrowd University - open source education content for the researcher community.
755 |

756 | 757 | #### Your daily knowledge and news  [[TOC]](#anger-table-of-contents) 758 | 759 | ##### :black_small_square: RSS Readers 760 | 761 |

762 |   :small_orange_diamond: Feedly - organize, read and share what matters to you.
763 |

764 | 765 | ##### :black_small_square: Security 766 | 767 |

768 |   :small_orange_diamond: Security Newsletter - security news as a weekly digest (email notifications).
769 |   :small_orange_diamond: Google Online Security Blog - the latest news and insights from Google on security and safety on the Internet.
770 |   :small_orange_diamond: Qualys Blog - expert network security guidance and news.
771 |   :small_orange_diamond: DARKReading - connecting the Information Security Community.
772 |   :small_orange_diamond: publiclyDisclosed - public disclosure watcher who keeps you up to date about the recently disclosed bugs.
773 |   :small_orange_diamond: Packet Storm - information security services, news, files, tools, exploits, advisories and whitepapers.
774 |   :small_orange_diamond: Sekurak - about security, penetration tests, vulnerabilities and many others (PL/EN).
775 |   :small_orange_diamond: nf.sec - basic aspects and mechanisms of Linux operating system security (PL).
776 |

777 | 778 | #### Other Cheat Sheets  [[TOC]](#anger-table-of-contents) 779 | 780 | ###### Build your own DNS Servers 781 | 782 |

783 |   :small_orange_diamond: Unbound DNS Tutorial - a validating, recursive, and caching DNS server.
784 |   :small_orange_diamond: Knot Resolver on Fedora - how to get faster and more secure DNS resolution with Knot Resolver on Fedora.
785 |   :small_orange_diamond: DNS-over-HTTPS - tutorial to setup your own DNS-over-HTTPS (DoH) server.
786 |   :small_orange_diamond: DNS Servers - how (and why) i run my own DNS Servers.
787 |

788 | 789 | ###### Build your own Certificate Authority 790 | 791 |

792 |   :small_orange_diamond: OpenSSL Certificate Authority - build your own certificate authority (CA) using the OpenSSL command-line tools.
793 |

794 | 795 | ###### Build your own System/Virtual Machine 796 | 797 |

798 |   :small_orange_diamond: os-tutorial - how to create an OS from scratch.
799 |   :small_orange_diamond: Write your Own Virtual Machine - how to write your own virtual machine (VM).
800 |

801 | 802 | ###### DNS Servers list (privacy) 803 | 804 | | IP | URL | 805 | | :--- | :--- | 806 | | **`84.200.69.80`** | [dns.watch](https://dns.watch/) | 807 | | **`94.247.43.254`** | [opennic.org](https://www.opennic.org/) | 808 | | **`64.6.64.6`** | [verisign.com](https://www.verisign.com/en_US/security-services/public-dns/index.xhtml) | 809 | | **`89.233.43.71`** | [censurfridns.dk](https://blog.uncensoreddns.org/) | 810 | | **`1.1.1.1`** | [cloudflare.com](https://www.cloudflare.com/dns/) | 811 | | **`94.130.110.185`** | [dnsprivacy.at](https://dnsprivacy.at/) | 812 | 813 | ###### TOP 10 Browser extensions 814 | 815 | | Extension name | Description | 816 | | :--- | :--- | 817 | | **`IPvFoo`** | Display the server IP address and HTTPS information across all page elements. | 818 | | **`FoxyProxy`** | Simplifies configuring browsers to access proxy-servers. | 819 | | **`HTTPS Everywhere`** | Automatically use HTTPS security on many sites. | 820 | | **`uMatrix`** | Point & click to forbid/allow any class of requests made by your browser. | 821 | | **`uBlock Origin`** | An efficient blocker: easy on memory and CPU footprint. | 822 | | **`Session Buddy`** | Manage browser tabs and bookmarks with ease. | 823 | | **`SuperSorter`** | Sort bookmarks recursively, delete duplicates, merge folders and more. | 824 | | **`Clear Cache`** | Clear your cache and browsing data. | 825 | | **`d3coder`** | Encoding/Decoding plugin for various types of encoding. | 826 | | **`Web Developer`** | Adds a toolbar button with various web developer tools. | 827 | 828 | ###### TOP 12 Burp extensions 829 | 830 | | Extension name | Description | 831 | | :--- | :--- | 832 | | **`Autorize`** | Automatically detects authorization enforcement. | 833 | | **`Reflection`** | An efficient blocker: easy on memory and CPU footprint. | 834 | | **`Logger++`** | Logs requests and responses for all Burp tools in a sortable table. | 835 | | **`Bypass WAF`** | Adds headers useful for bypassing some WAF devices. | 836 | | **`JSON Beautifier`** | Beautifies JSON content in the HTTP message viewer. | 837 | | **`JSON Web Tokens`** | Enables Burp to decode and manipulate JSON web tokens. | 838 | | **`CSP Auditor`** | Displays CSP headers for responses, and passively reports CSP weaknesses. | 839 | | **`CSP-Bypass`** | Passively scans for CSP headers that contain known bypasses.. | 840 | | **`Hackvertor`** | Converts data using a tag-based configuration to apply various encoding. | 841 | | **`Active Scan++`** | Extends Burp's active and passive scanning capabilities. | 842 | | **`HTML5 Auditor`** | Scans for usage of risky HTML5 features. | 843 | | **`Software Vulnerability Scanner`** | Software vulnerability scanner based on Vulners.com audit API. | 844 | 845 | #### One-liners  [[TOC]](#anger-table-of-contents) 846 | 847 | ##### Table of Contents 848 | 849 | - **[System](#system)** 850 | * [terminal](#tool-terminal) 851 | * [mount](#tool-mount) 852 | * [fuser](#tool-fuser) 853 | * [ps](#tool-ps) 854 | * [top](#tool-top) 855 | * [strace](#tool-strace) 856 | * [kill](#tool-kill) 857 | * [find](#tool-find) 858 | * [diff](#tool-diff) 859 | * [tail](#tool-tail) 860 | * [cpulimit](#tool-cpulimit) 861 | * [pwdx](#tool-pwdx) 862 | * [tr](#tool-tr) 863 | * [chmod](#tool-chmod) 864 | * [who](#tool-who) 865 | * [last](#tool-last) 866 | * [screen](#tool-screen) 867 | * [du](#tool-du) 868 | * [inotifywait](#tool-inotifywait) 869 | * [openssl](#tool-openssl) 870 | * [gnutls-cli](#tool-gnutls-cli) 871 | * [secure-delete](#tool-secure-delete) 872 | * [dd](#tool-dd) 873 | - **[HTTP/HTTPS](#http-https)** 874 | * [curl](#tool-curl) 875 | * [httpie](#tool-httpie) 876 | - **[Network](#network)** 877 | * [ssh](#tool-ssh) 878 | * [linux-dev](#tool-linux-dev) 879 | * [tcpdump](#tool-tcpdump) 880 | * [tcpick](#tool-tcpick) 881 | * [ngrep](#tool-ngrep) 882 | * [hping3](#tool-hping3) 883 | * [nmap](#tool-nmap) 884 | * [netcat](#tool-netcat) 885 | * [socat](#tool-socat) 886 | * [lsof](#tool-lsof) 887 | * [netstat](#tool-netstat) 888 | * [rsync](#tool-rsync) 889 | * [host](#tool-host) 890 | * [dig](#tool-dig) 891 | * [network-other](#tool-network-other) 892 | - **[Programming](#programming)** 893 | * [awk](#tool-awk) 894 | * [sed](#tool-sed) 895 | * [grep](#tool-grep) 896 | 897 | System 898 | 899 | ##### Tool: [terminal](https://en.wikipedia.org/wiki/Linux_console) 900 | 901 | ###### Reload shell without exit 902 | 903 | ```bash 904 | exec $SHELL -l 905 | ``` 906 | 907 | ###### Close shell keeping all subprocess running 908 | 909 | ```bash 910 | disown -a && exit 911 | ``` 912 | 913 | ###### Exit without saving shell history 914 | 915 | ```bash 916 | kill -9 $$ 917 | unset HISTFILE && exit 918 | ``` 919 | 920 | ###### Perform a branching conditional 921 | 922 | ```bash 923 | true && echo success 924 | false || echo failed 925 | ``` 926 | 927 | ###### Pipe stdout and stderr to separate commands 928 | 929 | ```bash 930 | some_command > >(/bin/cmd_for_stdout) 2> >(/bin/cmd_for_stderr) 931 | ``` 932 | 933 | ###### Redirect stdout and stderr each to separate files and print both to the screen 934 | 935 | ```bash 936 | (some_command 2>&1 1>&3 | tee errorlog ) 3>&1 1>&2 | tee stdoutlog 937 | ``` 938 | 939 | ###### List of commands you use most often 940 | 941 | ```bash 942 | history | \ 943 | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | \ 944 | grep -v "./" | \ 945 | column -c3 -s " " -t | \ 946 | sort -nr | nl | head -n 20 947 | ``` 948 | 949 | ###### Quickly backup a file 950 | 951 | ```bash 952 | cp filename{,.orig} 953 | ``` 954 | 955 | ###### Empty a file (truncate to 0 size) 956 | 957 | ```bash 958 | >filename 959 | ``` 960 | 961 | ###### Delete all files in a folder that don't match a certain file extension 962 | 963 | ```bash 964 | rm !(*.foo|*.bar|*.baz) 965 | ``` 966 | 967 | ###### Pass multi-line string to a file 968 | 969 | ```bash 970 | # cat >filename ... - overwrite file 971 | # cat >>filename ... - append to file 972 | cat > filename << __EOF__ 973 | data data data 974 | __EOF__ 975 | ``` 976 | 977 | ###### Edit a file on a remote host using vim 978 | 979 | ```bash 980 | vim scp://user@host//etc/fstab 981 | ``` 982 | 983 | ###### Create a directory and change into it at the same time 984 | 985 | ```bash 986 | mkd () { mkdir -p "$@" && cd "$@"; } 987 | ``` 988 | 989 | ###### Convert uppercase files to lowercase files 990 | 991 | ```bash 992 | rename 'y/A-Z/a-z/' * 993 | ``` 994 | 995 | ###### Print a row of characters across the terminal 996 | 997 | ```bash 998 | printf "%`tput cols`s" | tr ' ' '#' 999 | ``` 1000 | 1001 | ###### Show shell history without line numbers 1002 | 1003 | ```bash 1004 | history | cut -c 8- 1005 | fc -l -n 1 | sed 's/^\s*//' 1006 | ``` 1007 | 1008 | ###### Run command(s) after exit session 1009 | 1010 | ```bash 1011 | cat > /etc/profile << __EOF__ 1012 | _after_logout() { 1013 | 1014 | username=$(whoami) 1015 | 1016 | for _pid in $(ps afx | grep sshd | grep "$username" | awk '{print $1}') ; do 1017 | 1018 | kill -9 $_pid 1019 | 1020 | done 1021 | 1022 | } 1023 | trap _after_logout EXIT 1024 | __EOF__ 1025 | ``` 1026 | 1027 | ###### Generate a sequence of numbers 1028 | 1029 | ```bash 1030 | for ((i=1; i<=10; i+=2)) ; do echo $i ; done 1031 | # alternative: seq 1 2 10 1032 | 1033 | for ((i=5; i<=10; ++i)) ; do printf '%02d\n' $i ; done 1034 | # alternative: seq -w 5 10 1035 | ``` 1036 | 1037 | ___ 1038 | 1039 | ##### Tool: [mount](https://en.wikipedia.org/wiki/Mount_(Unix)) 1040 | 1041 | ###### Mount a temporary ram partition 1042 | 1043 | ```bash 1044 | mount -t tmpfs tmpfs /mnt -o size=64M 1045 | ``` 1046 | 1047 | * `-t` - filesystem type 1048 | * `-o` - mount options 1049 | 1050 | ###### Remount a filesystem as read/write 1051 | 1052 | ```bash 1053 | mount -o remount,rw / 1054 | ``` 1055 | 1056 | ___ 1057 | 1058 | ##### Tool: [fuser](https://en.wikipedia.org/wiki/Fuser_(Unix)) 1059 | 1060 | ###### Kills a process that is locking a file 1061 | 1062 | ```bash 1063 | fuser -k filename 1064 | ``` 1065 | 1066 | ###### Show what PID is listening on specific port 1067 | 1068 | ```bash 1069 | fuser -v 53/udp 1070 | ``` 1071 | 1072 | ___ 1073 | 1074 | ##### Tool: [ps](https://en.wikipedia.org/wiki/Ps_(Unix)) 1075 | 1076 | ###### Show a 4-way scrollable process tree with full details 1077 | 1078 | ```bash 1079 | ps awwfux | less -S 1080 | ``` 1081 | 1082 | ###### Processes per user counter 1083 | 1084 | ```bash 1085 | ps hax -o user | sort | uniq -c | sort -r 1086 | ``` 1087 | 1088 | ___ 1089 | 1090 | ##### Tool: [find](https://en.wikipedia.org/wiki/Find_(Unix)) 1091 | 1092 | ###### Find files that have been modified on your system in the past 60 minutes 1093 | 1094 | ```bash 1095 | find / -mmin 60 -type f 1096 | ``` 1097 | 1098 | ###### Find all files larger than 20M 1099 | 1100 | ```bash 1101 | find / -type f -size +20M 1102 | ``` 1103 | 1104 | ###### Find duplicate files (based on MD5 hash) 1105 | 1106 | ```bash 1107 | find -type f -exec md5sum '{}' ';' | sort | uniq --all-repeated=separate -w 33 1108 | ``` 1109 | 1110 | ###### Change permission only for files 1111 | 1112 | ```bash 1113 | cd /var/www/site && find . -type f -exec chmod 766 {} \; 1114 | cd /var/www/site && find . -type f -exec chmod 664 {} + 1115 | ``` 1116 | 1117 | ###### Change permission only for directories 1118 | 1119 | ```bash 1120 | cd /var/www/site && find . -type d -exec chmod g+x {} \; 1121 | cd /var/www/site && find . -type d -exec chmod g+rwx {} + 1122 | ``` 1123 | 1124 | ###### Find files and directories for specific user 1125 | 1126 | ```bash 1127 | find . -user -print 1128 | ``` 1129 | 1130 | ###### Find files and directories for all without specific user 1131 | 1132 | ```bash 1133 | find . \!-user -print 1134 | ``` 1135 | 1136 | ###### Delete older files than 60 days 1137 | 1138 | ```bash 1139 | find . -type f -mtime +60 -delete 1140 | ``` 1141 | 1142 | ###### Recursively remove all empty sub-directories from a directory 1143 | 1144 | ```bash 1145 | find . -depth -type d -empty -exec rmdir {} \; 1146 | ``` 1147 | 1148 | ###### How to find all hard links to a file 1149 | 1150 | ```bash 1151 | find -xdev -samefile filename 1152 | ``` 1153 | 1154 | ###### Recursively find the latest modified files 1155 | 1156 | ```bash 1157 | find . -type f -exec stat --format '%Y :%y %n' "{}" \; | sort -nr | cut -d: -f2- | head 1158 | ``` 1159 | 1160 | ___ 1161 | 1162 | ##### Tool: [top](https://en.wikipedia.org/wiki/Top_(software)) 1163 | 1164 | ###### Use top to monitor only all processes with the specific string 1165 | 1166 | ```bash 1167 | top -p $(pgrep -d , ) 1168 | ``` 1169 | 1170 | * `` - process containing str (eg. nginx, worker) 1171 | 1172 | ___ 1173 | 1174 | ##### Tool: [strace](https://en.wikipedia.org/wiki/Strace) 1175 | 1176 | ###### Track child process 1177 | 1178 | ```bash 1179 | strace -f -p $(pidof glusterfsd) 1180 | ``` 1181 | 1182 | ###### Track process after 30 seconds 1183 | 1184 | ```bash 1185 | timeout 30 strace $(< /var/run/zabbix/zabbix_agentd.pid) 1186 | ``` 1187 | 1188 | ###### Track child process and redirect output to a file 1189 | 1190 | ```bash 1191 | ps auxw | grep 'sbin/[a]pache' | awk '{print " -p " $2}' | xargs strace -o /tmp/strace-apache-proc.out 1192 | ``` 1193 | 1194 | ###### Track the open request of a network port 1195 | 1196 | ```bash 1197 | strace -f -e trace=bind nc -l 80 1198 | ``` 1199 | 1200 | ###### Track the open request of a network port (show TCP/UDP) 1201 | 1202 | ```bash 1203 | strace -f -e trace=network nc -lu 80 1204 | ``` 1205 | 1206 | ___ 1207 | 1208 | ##### Tool: [kill](https://en.wikipedia.org/wiki/Kill_(command)) 1209 | 1210 | ###### Kill a process running on port 1211 | 1212 | ```bash 1213 | kill -9 $(lsof -i : | awk '{l=$2} END {print l}') 1214 | ``` 1215 | 1216 | ___ 1217 | 1218 | ##### Tool: [diff](https://en.wikipedia.org/wiki/Diff) 1219 | 1220 | ###### Compare two directory trees 1221 | 1222 | ```bash 1223 | diff <(cd directory1 && find | sort) <(cd directory2 && find | sort) 1224 | ``` 1225 | 1226 | ___ 1227 | 1228 | ##### Tool: [tail](https://en.wikipedia.org/wiki/Tail_(Unix)) 1229 | 1230 | ###### Annotate tail -f with timestamps 1231 | 1232 | ```bash 1233 | tail -f file | while read ; do echo "$(date +%T.%N) $REPLY" ; done 1234 | ``` 1235 | 1236 | ###### Analyse an Apache access log for the most common IP addresses 1237 | 1238 | ```bash 1239 | tail -10000 access_log | awk '{print $1}' | sort | uniq -c | sort -n | tail 1240 | ``` 1241 | 1242 | ###### Analyse web server log and show only 5xx http codes 1243 | 1244 | ```bash 1245 | tail -n 100 -f /path/to/logfile | grep "HTTP/[1-2].[0-1]\" [5]" 1246 | ``` 1247 | 1248 | ___ 1249 | 1250 | ##### Tool: [tar](https://en.wikipedia.org/wiki/Tar_(computing)) 1251 | 1252 | ###### System backup with exclude specific directories 1253 | 1254 | ```bash 1255 | cd / 1256 | tar -czvpf /mnt/system$(date +%d%m%Y%s).tgz --directory=/ \ 1257 | --exclude=proc/* --exclude=sys/* --exclude=dev/* --exclude=mnt/* . 1258 | ``` 1259 | 1260 | ###### System backup with exclude specific directories (pigz) 1261 | 1262 | ```bash 1263 | cd / 1264 | tar cvpf /backup/snapshot-$(date +%d%m%Y%s).tgz --directory=/ \ 1265 | --exclude=proc/* --exclude=sys/* --exclude=dev/* \ 1266 | --exclude=mnt/* --exclude=tmp/* --use-compress-program=pigz . 1267 | ``` 1268 | 1269 | ___ 1270 | 1271 | ##### Tool: [dump](https://en.wikipedia.org/wiki/Dump_(program)) 1272 | 1273 | ###### System backup to file 1274 | 1275 | ```bash 1276 | dump -y -u -f /backup/system$(date +%d%m%Y%s).lzo / 1277 | ``` 1278 | 1279 | ###### Restore system from lzo file 1280 | 1281 | ```bash 1282 | cd / 1283 | restore -rf /backup/system$(date +%d%m%Y%s).lzo 1284 | ``` 1285 | 1286 | ___ 1287 | 1288 | ##### Tool: [cpulimit](http://cpulimit.sourceforge.net/) 1289 | 1290 | ###### Limit the cpu usage of a process 1291 | 1292 | ```bash 1293 | cpulimit -p pid -l 50 1294 | ``` 1295 | 1296 | ___ 1297 | 1298 | ##### Tool: [pwdx](https://www.cyberciti.biz/faq/unix-linux-pwdx-command-examples-usage-syntax/) 1299 | 1300 | ###### Show current working directory of a process 1301 | 1302 | ```bash 1303 | pwdx 1304 | ``` 1305 | 1306 | ___ 1307 | 1308 | ##### Tool: [taskset](https://www.cyberciti.biz/faq/taskset-cpu-affinity-command/) 1309 | 1310 | ###### Start a command on only one CPU core 1311 | 1312 | ```bash 1313 | taskset -c 0 1314 | ``` 1315 | 1316 | ___ 1317 | 1318 | ##### Tool: [tr](https://en.wikipedia.org/wiki/Tr_(Unix)) 1319 | 1320 | ###### Show directories in the PATH, one per line 1321 | 1322 | ```bash 1323 | tr : '\n' <<<$PATH 1324 | ``` 1325 | 1326 | ___ 1327 | 1328 | ##### Tool: [chmod](https://en.wikipedia.org/wiki/Chmod) 1329 | 1330 | ###### Remove executable bit from all files in the current directory 1331 | 1332 | ```bash 1333 | chmod -R -x+X * 1334 | ``` 1335 | 1336 | ###### Restore permission for /bin/chmod 1337 | 1338 | ```bash 1339 | # 1: 1340 | cp /bin/ls chmod.01 1341 | cp /bin/chmod chmod.01 1342 | ./chmod.01 700 file 1343 | 1344 | # 2: 1345 | /bin/busybox chmod 0700 /bin/chmod 1346 | 1347 | # 3: 1348 | setfacl --set u::rwx,g::---,o::--- /bin/chmod 1349 | ``` 1350 | 1351 | ___ 1352 | 1353 | ##### Tool: [who](https://en.wikipedia.org/wiki/Who_(Unix)) 1354 | 1355 | ###### Find last reboot time 1356 | 1357 | ```bash 1358 | who -b 1359 | ``` 1360 | 1361 | ###### Detect a user sudo-su'd into the current shell 1362 | 1363 | ```bash 1364 | [[ $(who -m | awk '{ print $1 }') == $(whoami) ]] || echo "You are su-ed to $(whoami)" 1365 | ``` 1366 | 1367 | ___ 1368 | 1369 | ##### Tool: [last](https://www.howtoforge.com/linux-last-command/) 1370 | 1371 | ###### Was the last reboot a panic? 1372 | 1373 | ```bash 1374 | (last -x -f $(ls -1t /var/log/wtmp* | head -2 | tail -1); last -x -f /var/log/wtmp) | grep -A1 reboot | head -2 | grep -q shutdown && echo "Expected reboot" || echo "Panic reboot" 1375 | ``` 1376 | 1377 | ___ 1378 | 1379 | ##### Tool: [screen](https://en.wikipedia.org/wiki/GNU_Screen) 1380 | 1381 | ###### Start screen in detached mode 1382 | 1383 | ```bash 1384 | screen -d -m [] 1385 | ``` 1386 | 1387 | ___ 1388 | 1389 | ##### Tool: [du](https://en.wikipedia.org/wiki/GNU_Screen) 1390 | 1391 | ###### Show 20 biggest directories with 'K M G' 1392 | 1393 | ```bash 1394 | du | \ 1395 | sort -r -n | \ 1396 | awk '{split("K M G",v); s=1; while($1>1024){$1/=1024; s++} print int($1)" "v[s]"\t"$2}' | \ 1397 | head -n 20 1398 | ``` 1399 | 1400 | ___ 1401 | 1402 | ##### Tool: [inotifywait](https://en.wikipedia.org/wiki/GNU_Screen) 1403 | 1404 | ###### Init tool everytime a file in a directory is modified 1405 | 1406 | ```bash 1407 | while true ; do inotifywait -r -e MODIFY dir/ && ls dir/ ; done; 1408 | ``` 1409 | 1410 | ___ 1411 | 1412 | ##### Tool: [openssl](https://www.openssl.org/) 1413 | 1414 | ###### Testing connection to remote host 1415 | 1416 | ```bash 1417 | echo | openssl s_client -connect google.com:443 -showcerts 1418 | ``` 1419 | 1420 | ###### Testing connection to remote host (with SNI support) 1421 | 1422 | ```bash 1423 | echo | openssl s_client -showcerts -servername google.com -connect google.com:443 1424 | ``` 1425 | 1426 | ###### Testing connection to remote host with specific ssl version 1427 | 1428 | ```bash 1429 | openssl s_client -tls1_2 -connect google.com:443 1430 | ``` 1431 | 1432 | ###### Testing connection to remote host with specific ssl cipher 1433 | 1434 | ```bash 1435 | openssl s_client -cipher 'AES128-SHA' -connect google.com:443 1436 | ``` 1437 | 1438 | ###### Generate private key 1439 | 1440 | ```bash 1441 | # _len: 2048, 4096 1442 | ( _fd="private.key" ; _len="4096" ; \ 1443 | openssl genrsa -out ${_fd} ${_len} ) 1444 | ``` 1445 | 1446 | ###### Generate private key with password 1447 | 1448 | ```bash 1449 | # _ciph: des3, aes128, aes256 1450 | # _len: 2048, 4096 1451 | ( _ciph="aes128" ; _fd="private.key" ; _len="4096" ; \ 1452 | openssl genrsa -${_ciph} -out ${_fd} ${_len} ) 1453 | ``` 1454 | 1455 | ###### Remove password from private key 1456 | 1457 | ```bash 1458 | ( _fd="private.key" ; _fd_unp="private_unp.key" ; \ 1459 | openssl rsa -in ${_fd} -out ${_fd_unp} ) 1460 | ``` 1461 | 1462 | ###### Get public key from private key 1463 | 1464 | ```bash 1465 | ( _fd="private.key" ; _fd_pub="public.key" ; \ 1466 | openssl rsa -pubout -in ${_fd} -out ${_fd_pub} ) 1467 | ``` 1468 | 1469 | ###### Generate private key + csr 1470 | 1471 | ```bash 1472 | ( _fd="private.key" ; _fd_csr="request.csr" ; _len="4096" ; \ 1473 | openssl req -out ${_fd_csr} -new -newkey rsa:${_len} -nodes -keyout ${_fd} ) 1474 | ``` 1475 | 1476 | ###### Generate csr 1477 | 1478 | ```bash 1479 | ( _fd="private.key" ; _fd_csr="request.csr" ; \ 1480 | openssl req -out ${_fd_csr} -new -key ${_fd} ) 1481 | ``` 1482 | 1483 | ###### Generate csr (metadata from exist certificate) 1484 | 1485 | ```bash 1486 | ( _fd="private.key" ; _fd_csr="request.csr" ; _fd_crt="cert.crt" ; \ 1487 | openssl x509 -x509toreq -in ${_fd_crt} -out ${_fd_csr} -signkey ${_fd} ) 1488 | ``` 1489 | 1490 | ###### Generate csr with -config param 1491 | 1492 | ```bash 1493 | ( _fd="private.key" ; _fd_csr="request.csr" ; \ 1494 | openssl req -new -sha256 -key ${_fd} -out ${_fd_csr} \ 1495 | -config <( 1496 | cat <<-EOF 1497 | [req] 1498 | default_bits = 2048 1499 | prompt = no 1500 | default_md = sha256 1501 | req_extensions = req_ext 1502 | distinguished_name = dn 1503 | 1504 | [ dn ] 1505 | C= 1506 | ST= 1507 | L= 1508 | O= 1509 | OU=
1510 | CN= 1511 | 1512 | [ req_ext ] 1513 | subjectAltName = @alt_names 1514 | 1515 | [ alt_names ] 1516 | DNS.1 = 1517 | DNS.2 = 1518 | DNS.3 = 1519 | EOF 1520 | )) 1521 | ``` 1522 | 1523 | ###### Convert DER to PEM 1524 | 1525 | ```bash 1526 | ( _fd_der="cert.crt" ; _fd_pem="cert.pem" ; \ 1527 | openssl x509 -in ${_fd_der} -inform der -outform pem -out ${_fd_pem} ) 1528 | ``` 1529 | 1530 | ###### Convert PEM to DER 1531 | 1532 | ```bash 1533 | ( _fd_der="cert.crt" ; _fd_pem="cert.pem" ; \ 1534 | openssl x509 -in ${_fd_pem} -outform der -out ${_fd_der} ) 1535 | ``` 1536 | 1537 | ###### Checking whether the private key and the certificate match 1538 | 1539 | ```bash 1540 | (openssl rsa -noout -modulus -in private.key | openssl md5 ; openssl x509 -noout -modulus -in certificate.crt | openssl md5) | uniq 1541 | ``` 1542 | 1543 | ___ 1544 | 1545 | ##### Tool: [gnutls-cli](https://gnutls.org/manual/html_node/gnutls_002dcli-Invocation.html) 1546 | 1547 | ###### Testing connection to remote host (with SNI support) 1548 | 1549 | ```bash 1550 | gnutls-cli -p 443 google.com 1551 | ``` 1552 | 1553 | ###### Testing connection to remote host (without SNI support) 1554 | 1555 | ```bash 1556 | gnutls-cli --disable-sni -p 443 google.com 1557 | ``` 1558 | 1559 | ___ 1560 | 1561 | ##### Tool: [secure-delete](https://wiki.archlinux.org/index.php/Securely_wipe_disk) 1562 | 1563 | ###### Secure delete with shred 1564 | 1565 | ```bash 1566 | shred -vfuz -n 10 file 1567 | shred --verbose --random-source=/dev/urandom -n 1 /dev/sda 1568 | ``` 1569 | 1570 | ###### Secure delete with scrub 1571 | 1572 | ```bash 1573 | scrub -p dod /dev/sda 1574 | scrub -p dod -r file 1575 | ``` 1576 | 1577 | ###### Secure delete with badblocks 1578 | 1579 | ```bash 1580 | badblocks -s -w -t random -v /dev/sda 1581 | badblocks -c 10240 -s -w -t random -v /dev/sda 1582 | ``` 1583 | 1584 | ###### Secure delete with secure-delete 1585 | 1586 | ```bash 1587 | srm -vz /tmp/file 1588 | sfill -vz /local 1589 | sdmem -v 1590 | swapoff /dev/sda5 && sswap -vz /dev/sda5 1591 | ``` 1592 | 1593 | ___ 1594 | 1595 | ##### Tool: [dd](https://en.wikipedia.org/wiki/Dd_(Unix)) 1596 | 1597 | ###### Show dd status every so often 1598 | 1599 | ```bash 1600 | dd status=progress 1601 | watch --interval 5 killall -USR1 dd 1602 | ``` 1603 | 1604 | ###### Redirect output to a file with dd 1605 | 1606 | ```bash 1607 | echo "string" | dd of=filename 1608 | ``` 1609 | 1610 | HTTP/HTTPS 1611 | 1612 | ##### Tool: [curl](https://curl.haxx.se) 1613 | 1614 | ```bash 1615 | curl -Iks https://www.google.com 1616 | ``` 1617 | 1618 | * `-I` - show response headers only 1619 | * `-k` - insecure connection when using ssl 1620 | * `-s` - silent mode (not display body) 1621 | 1622 | ```bash 1623 | curl -Iks --location -X GET -A "x-agent" https://www.google.com 1624 | ``` 1625 | 1626 | * `--location` - follow redirects 1627 | * `-X` - set method 1628 | * `-A` - set user-agent 1629 | 1630 | ```bash 1631 | curl -Iks --location -X GET -A "x-agent" --proxy http://127.0.0.1:16379 https://www.google.com 1632 | ``` 1633 | 1634 | * `--proxy [socks5://|http://]` - set proxy server 1635 | 1636 | ###### Check DNS and HTTP trace with headers for specific domains 1637 | 1638 | ```bash 1639 | ### Set domains and external dns servers. 1640 | _domain_list=(google.com) ; _dns_list=("8.8.8.8" "1.1.1.1") 1641 | 1642 | for _domain in "${_domain_list[@]}" ; do 1643 | 1644 | printf '=%.0s' {1..48} 1645 | 1646 | echo 1647 | 1648 | printf "[\\e[1;32m+\\e[m] resolve: %s\\n" "$_domain" 1649 | 1650 | for _dns in "${_dns_list[@]}" ; do 1651 | 1652 | # Resolve domain. 1653 | host "${_domain}" "${_dns}" 1654 | 1655 | echo 1656 | 1657 | done 1658 | 1659 | for _proto in http https ; do 1660 | 1661 | printf "[\\e[1;32m+\\e[m] trace + headers: %s://%s\\n" "$_proto" "$_domain" 1662 | 1663 | # Get trace and http headers. 1664 | curl -Iks -A "x-agent" --location "${_proto}://${_domain}" 1665 | 1666 | echo 1667 | 1668 | done 1669 | 1670 | done 1671 | 1672 | unset _domain_list _dns_list 1673 | ``` 1674 | 1675 | ___ 1676 | 1677 | ##### Tool: [httpie](https://httpie.org/) 1678 | 1679 | ```bash 1680 | http -p Hh https://www.google.com 1681 | ``` 1682 | 1683 | * `-p` - print request and response headers 1684 | * `H` - request headers 1685 | * `B` - request body 1686 | * `h` - response headers 1687 | * `b` - response body 1688 | 1689 | ```bash 1690 | http -p Hh --follow --max-redirects 5 --verify no https://www.google.com 1691 | ``` 1692 | 1693 | * `-F, --follow` - follow redirects 1694 | * `--max-redirects N` - maximum for `--follow` 1695 | * `--verify no` - skip SSL verification 1696 | 1697 | ```bash 1698 | http -p Hh --follow --max-redirects 5 --verify no --proxy http:http://127.0.0.1:16379 https://www.google.com 1699 | ``` 1700 | 1701 | * `--proxy [http:]` - set proxy server 1702 | 1703 | Network 1704 | 1705 | ##### Tool: [ssh](https://www.openssh.com/) 1706 | 1707 | ###### Compare a remote file with a local file 1708 | 1709 | ```bash 1710 | ssh user@host cat /path/to/remotefile | diff /path/to/localfile - 1711 | ``` 1712 | 1713 | ###### SSH connection through host in the middle 1714 | 1715 | ```bash 1716 | ssh -t reachable_host ssh unreachable_host 1717 | ``` 1718 | 1719 | ###### Run command over ssh on remote host 1720 | 1721 | ```bash 1722 | cat > cmd.txt << __EOF__ 1723 | cat /etc/hosts 1724 | __EOF__ 1725 | 1726 | ssh host -l user $(&1 | tee -a "${_sesdir}/$(date +%Y%m%d).log" 1762 | 1763 | } 1764 | 1765 | # Alias: 1766 | alias ssh='_ssh_sesslog' 1767 | ``` 1768 | 1769 | ###### Using Keychain for SSH logins 1770 | 1771 | ```bash 1772 | ### Delete all of ssh-agent's keys. 1773 | function _scl() { 1774 | 1775 | /usr/bin/keychain --clear 1776 | 1777 | } 1778 | 1779 | ### Add key to keychain. 1780 | function _scg() { 1781 | 1782 | /usr/bin/keychain /path/to/private-key 1783 | source "$HOME/.keychain/$HOSTNAME-sh" 1784 | 1785 | } 1786 | ``` 1787 | 1788 | ###### SSH login without processing any login scripts 1789 | 1790 | ```bash 1791 | ssh -tt user@host bash 1792 | ``` 1793 | 1794 | ###### SSH local port forwarding 1795 | 1796 | Example 1: 1797 | 1798 | ```bash 1799 | # Forwarding our local 2250 port to nmap.org:443 from localhost through localhost 1800 | host1> ssh -L 2250:nmap.org:443 localhost 1801 | 1802 | # Connect to the service: 1803 | host1> curl -Iks --location -X GET https://localhost:2250 1804 | ``` 1805 | 1806 | Example 2: 1807 | 1808 | ```bash 1809 | # Forwarding our local 9051 port to db.d.x:5432 from localhost through node.d.y 1810 | host1> ssh -nNT -L 9051:db.d.x:5432 node.d.y 1811 | 1812 | # Connect to the service: 1813 | host1> psql -U db_user -d db_dev -p 9051 -h localhost 1814 | ``` 1815 | 1816 | * `-n` - redirects stdin from `/dev/null` 1817 | * `-N` - do not execute a remote command 1818 | * `-T` - disable pseudo-terminal allocation 1819 | 1820 | ###### SSH remote port forwarding 1821 | 1822 | ```bash 1823 | # Forwarding our local 9051 port to db.d.x:5432 from host2 through node.d.y 1824 | host1> ssh -nNT -R 9051:db.d.x:5432 node.d.y 1825 | 1826 | # Connect to the service: 1827 | host2> psql -U postgres -d postgres -p 8000 -h localhost 1828 | ``` 1829 | 1830 | ___ 1831 | 1832 | ##### Tool: [linux-dev](https://www.tldp.org/LDP/abs/html/devref1.html) 1833 | 1834 | ###### Testing remote connection to port 1835 | 1836 | ```bash 1837 | timeout 1 bash -c "//" >/dev/null 2>&1 ; echo $? 1838 | ``` 1839 | 1840 | * `` - set remote host 1842 | * `` - set destination port 1843 | 1844 | ###### Read and write to TCP or UDP sockets with common bash tools 1845 | 1846 | ```bash 1847 | exec 5<>/dev/tcp//; cat <&5 & cat >&5; exec 5>&- 1848 | ``` 1849 | 1850 | ___ 1851 | 1852 | ##### Tool: [tcpdump](http://www.tcpdump.org/) 1853 | 1854 | ###### Filter incoming (on interface) traffic (specific ) 1855 | 1856 | ```bash 1857 | tcpdump -ne -i eth0 -Q in host 192.168.252.1 and port 443 1858 | ``` 1859 | 1860 | * `-n` - don't convert addresses (`-nn` will not resolve hostnames or ports) 1861 | * `-e` - print the link-level headers 1862 | * `-i [iface|any]` - set interface 1863 | * `-Q|-D [in|out|inout]` - choose send/receive direction (`-D` - for old tcpdump versions) 1864 | * `host [ip|hostname]` - set host, also `[host not]` 1865 | * `[and|or]` - set logic 1866 | * `port [1-65535]` - set port number, also `[port not]` 1867 | 1868 | ###### Filter incoming (on interface) traffic (specific ) and write to a file 1869 | 1870 | ```bash 1871 | tcpdump -ne -i eth0 -Q in host 192.168.252.1 and port 443 -c 5 -w tcpdump.pcap 1872 | ``` 1873 | 1874 | * `-c [num]` - capture only num number of packets 1875 | * `-w [filename]` - write packets to file, `-r [filename]` - reading from file 1876 | 1877 | ###### Capture all ICMP packets 1878 | 1879 | ```bash 1880 | tcpdump -nei eth0 icmp 1881 | ``` 1882 | 1883 | ###### Display ASCII text (to parse the output using grep or other) 1884 | 1885 | ```bash 1886 | tcpdump -i eth0 -A -s0 port 443 1887 | ``` 1888 | 1889 | ###### Grab everything between two keywords 1890 | 1891 | ```bash 1892 | tcpdump -i eth0 port 80 -X | sed -n -e '/username/,/=ldap/ p' 1893 | ``` 1894 | 1895 | ###### Grab user and pass ever plain http 1896 | 1897 | ```bash 1898 | tcpdump -i eth0 port http -l -A | egrep -i 'pass=|pwd=|log=|login=|user=|username=|pw=|passw=|passwd=|password=|pass:|user:|username:|password:|login:|pass |user ' --color=auto --line-buffered -B20 1899 | ``` 1900 | 1901 | ###### Extract HTTP User Agent from HTTP request header 1902 | 1903 | ```bash 1904 | tcpdump -ei eth0 -nn -A -s1500 -l | grep "User-Agent:" 1905 | ``` 1906 | 1907 | ###### Capture only HTTP GET and POST packets 1908 | 1909 | ```bash 1910 | tcpdump -ei eth0 -s 0 -A -vv 'tcp[((tcp[12:1] & 0xf0) >> 2):4] = 0x47455420' or 'tcp[((tcp[12:1] & 0xf0) >> 2):4] = 0x504f5354' 1911 | ``` 1912 | 1913 | or simply: 1914 | 1915 | ```bash 1916 | tcpdump -ei eth0 -s 0 -v -n -l | egrep -i "POST /|GET /|Host:" 1917 | ``` 1918 | 1919 | ###### Rotate capture files 1920 | 1921 | ```bash 1922 | tcpdump -ei eth0 -w /tmp/capture-%H.pcap -G 3600 -C 200 1923 | ``` 1924 | 1925 | * `-G ` - pcap will be created every `` seconds 1926 | * `-C ` - close the current pcap and open a new one if is larger than `` 1927 | 1928 | ###### Top hosts by packets 1929 | 1930 | ```bash 1931 | tcpdump -ei enp0s25 -nnn -t -c 200 | cut -f 1,2,3,4 -d '.' | sort | uniq -c | sort -nr | head -n 20 1932 | ``` 1933 | 1934 | ___ 1935 | 1936 | ##### Tool: [tcpick](http://tcpick.sourceforge.net/) 1937 | 1938 | ###### Analyse packets in real-time 1939 | 1940 | ```bash 1941 | while true ; do tcpick -a -C -r dump.pcap ; sleep 2 ; clear ; done 1942 | ``` 1943 | 1944 | ___ 1945 | 1946 | ##### Tool: [ngrep](http://ngrep.sourceforge.net/usage.html) 1947 | 1948 | ```bash 1949 | ngrep -d eth0 "www.google.com" port 443 1950 | ``` 1951 | 1952 | * `-d [iface|any]` - set interface 1953 | * `[domain]` - set hostname 1954 | * `port [1-65535]` - set port number 1955 | 1956 | ```bash 1957 | ngrep -d eth0 "www.google.com" (host 10.240.20.2) and (port 443) 1958 | ``` 1959 | 1960 | * `(host [ip|hostname])` - filter by ip or hostname 1961 | * `(port [1-65535])` - filter by port number 1962 | 1963 | ```bash 1964 | ngrep -d eth0 -qt -O ngrep.pcap "www.google.com" port 443 1965 | ``` 1966 | 1967 | * `-q` - quiet mode (only payloads) 1968 | * `-t` - added timestamps 1969 | * `-O [filename]` - save output to file, `-I [filename]` - reading from file 1970 | 1971 | ```bash 1972 | ngrep -d eth0 -qt 'HTTP' 'tcp' 1973 | ``` 1974 | 1975 | * `HTTP` - show http headers 1976 | * `tcp|udp` - set protocol 1977 | * `[src|dst] host [ip|hostname]` - set direction for specific node 1978 | 1979 | ```bash 1980 | ngrep -l -q -d eth0 -i "User-Agent: curl*" 1981 | ``` 1982 | 1983 | * `-l` - stdout line buffered 1984 | * `-i` - case-insensitive search 1985 | 1986 | ___ 1987 | 1988 | ##### Tool: [hping3](http://www.hping.org/) 1989 | 1990 | ```bash 1991 | hping3 -V -p 80 -s 5050 www.google.com 1992 | ``` 1993 | 1994 | * `-V|--verbose` - verbose mode 1995 | * `-p|--destport` - set destination port 1996 | * `-s|--baseport` - set source port 1997 | * `` - set scan type 1998 | * `-F|--fin` - set FIN flag, port open if no reply 1999 | * `-S|--syn` - set SYN flag 2000 | * `-P|--push` - set PUSH flag 2001 | * `-A|--ack` - set ACK flag (use when ping is blocked, RST response back if the port is open) 2002 | * `-U|--urg` - set URG flag 2003 | * `-Y|--ymas` - set Y unused flag (0x80 - nullscan), port open if no reply 2004 | * `-M 0 -UPF` - set TCP sequence number and scan type (URG+PUSH+FIN), port open if no reply 2005 | 2006 | ```bash 2007 | hping3 -V -c 1 -1 -C 8 www.google.com 2008 | ``` 2009 | 2010 | * `-c [num]` - packet count 2011 | * `-1` - set ICMP mode 2012 | * `-C|--icmptype [icmp-num]` - set icmp type (default icmp-echo = 8) 2013 | 2014 | ```bash 2015 | hping3 -V -c 1000000 -d 120 -S -w 64 -p 80 --flood --rand-source 2016 | ``` 2017 | 2018 | * `--flood` - sent packets as fast as possible (don't show replies) 2019 | * `--rand-source` - random source address mode 2020 | * `-d --data` - data size 2021 | * `-w|--win` - winsize (default 64) 2022 | 2023 | ___ 2024 | 2025 | ##### Tool: [nmap](https://nmap.org/) 2026 | 2027 | ###### Ping scans the network 2028 | 2029 | ```bash 2030 | nmap -sP 192.168.0.0/24 2031 | ``` 2032 | 2033 | ###### Show only open ports 2034 | 2035 | ```bash 2036 | nmap -F --open 192.168.0.0/24 2037 | ``` 2038 | 2039 | ###### Check protocol used (TCP or UDP) for service 2040 | 2041 | ```bash 2042 | tcpdump -nei eth0 tcp port 22 -vv -X | egrep "TCP|UDP" 2043 | ``` 2044 | 2045 | ###### Full TCP port scan using with service version detection 2046 | 2047 | ```bash 2048 | nmap -p 1-65535 -sV -sS -T4 192.168.0.0/24 2049 | ``` 2050 | 2051 | ###### Nmap scan and pass output to Nikto 2052 | 2053 | ```bash 2054 | nmap -p80,443 192.168.0.0/24 -oG - | nikto.pl -h - 2055 | ``` 2056 | 2057 | ###### Recon specific ip:service with Nmap NSE scripts stack 2058 | 2059 | ```bash 2060 | # Set variables: 2061 | _hosts="192.168.250.10" 2062 | _ports="80,443" 2063 | 2064 | # Set Nmap NSE scripts stack: 2065 | _nmap_nse_scripts="+dns-brute,\ 2066 | +http-auth-finder,\ 2067 | +http-chrono,\ 2068 | +http-cookie-flags,\ 2069 | +http-cors,\ 2070 | +http-cross-domain-policy,\ 2071 | +http-csrf,\ 2072 | +http-dombased-xss,\ 2073 | +http-enum,\ 2074 | +http-errors,\ 2075 | +http-git,\ 2076 | +http-grep,\ 2077 | +http-internal-ip-disclosure,\ 2078 | +http-jsonp-detection,\ 2079 | +http-malware-host,\ 2080 | +http-methods,\ 2081 | +http-passwd,\ 2082 | +http-phpself-xss,\ 2083 | +http-php-version,\ 2084 | +http-robots.txt,\ 2085 | +http-sitemap-generator,\ 2086 | +http-shellshock,\ 2087 | +http-stored-xss,\ 2088 | +http-title,\ 2089 | +http-unsafe-output-escaping,\ 2090 | +http-useragent-tester,\ 2091 | +http-vhosts,\ 2092 | +http-waf-detect,\ 2093 | +http-waf-fingerprint,\ 2094 | +http-xssed,\ 2095 | +traceroute-geolocation.nse,\ 2096 | +ssl-enum-ciphers,\ 2097 | +whois-domain,\ 2098 | +whois-ip" 2099 | 2100 | # Set Nmap NSE script params: 2101 | _nmap_nse_scripts_args="dns-brute.domain=${_hosts},http-cross-domain-policy.domain-lookup=true,http-waf-detect.aggro,http-waf-detect.detectBodyChanges,http-waf-fingerprint.intensive=1" 2102 | 2103 | # Perform scan: 2104 | nmap --script="$_nmap_nse_scripts" --script-args="$_nmap_nse_scripts_args" -p "$_ports" "$_hosts" 2105 | ``` 2106 | 2107 | ___ 2108 | 2109 | ##### Tool: [netcat](http://netcat.sourceforge.net/) 2110 | 2111 | ```bash 2112 | nc -kl 5000 2113 | ``` 2114 | 2115 | * `-l` - listen for an incoming connection 2116 | * `-k` - listening after client has disconnected 2117 | * `>filename.out` - save receive data to file (optional) 2118 | 2119 | ```bash 2120 | nc 192.168.0.1 5051 < filename.in 2121 | ``` 2122 | 2123 | * `< filename.in` - send data to remote host 2124 | 2125 | ```bash 2126 | nc -vz 10.240.30.3 5000 2127 | ``` 2128 | 2129 | * `-v` - verbose output 2130 | * `-z` - scan for listening daemons 2131 | 2132 | ```bash 2133 | nc -vzu 10.240.30.3 1-65535 2134 | ``` 2135 | 2136 | * `-u` - scan only udp ports 2137 | 2138 | ###### Transfer data file (archive) 2139 | 2140 | ```bash 2141 | server> nc -l 5000 | tar xzvfp - 2142 | client> tar czvfp - /path/to/dir | nc 10.240.30.3 5000 2143 | ``` 2144 | 2145 | ###### Launch remote shell 2146 | 2147 | ```bash 2148 | server> nc -l 5000 -e /bin/bash 2149 | client> nc 10.240.30.3 5000 2150 | ``` 2151 | 2152 | ###### Simple file server 2153 | 2154 | ```bash 2155 | while true ; do nc -l 5000 | tar -xvf - ; done 2156 | ``` 2157 | 2158 | ###### Simple minimal HTTP Server 2159 | 2160 | ```bash 2161 | while true ; do nc -l -p 1500 -c 'echo -e "HTTP/1.1 200 OK\n\n $(date)"' ; done 2162 | ``` 2163 | 2164 | ###### Simple HTTP Server 2165 | 2166 | > Restarts web server after each request - remove `while` condition for only single connection. 2167 | 2168 | ```bash 2169 | cat > index.html << __EOF__ 2170 | 2171 | 2172 | 2173 | 2174 | 2175 | 2176 | 2177 | 2178 | 2179 | 2180 |

2181 | 2182 | Hello! It's a site. 2183 | 2184 |

2185 | 2186 | 2187 | 2188 | __EOF__ 2189 | ``` 2190 | 2191 | ```bash 2192 | server> while : ; do \ 2193 | (echo -ne "HTTP/1.1 200 OK\r\nContent-Length: $(wc -c /" <"$_sent" & 2227 | sed "s/^/<= /" <"$_recv" & 2228 | 2229 | nc -l -p "$_listen_port" <"$_back" | \ 2230 | tee "$_sent" | \ 2231 | nc "$_bk_host" "$_bk_port" | \ 2232 | tee "$_recv" >"$_back" 2233 | ``` 2234 | 2235 | ```bash 2236 | server> chmod +x nc-proxy && ./nc-proxy 8080 192.168.252.10:8000 2237 | lport: 8080 2238 | bk_host: 192.168.252.10 2239 | bk_port: 8000 2240 | 2241 | client> http -p h 10.240.30.3:8080 2242 | HTTP/1.1 200 OK 2243 | Accept-Ranges: bytes 2244 | Cache-Control: max-age=31536000 2245 | Content-Length: 2748 2246 | Content-Type: text/html; charset=utf-8 2247 | Date: Sun, 01 Jul 2018 20:12:08 GMT 2248 | Last-Modified: Sun, 01 Apr 2018 21:53:37 GMT 2249 | ``` 2250 | 2251 | ###### Create a single-use TCP or UDP proxy 2252 | 2253 | ```bash 2254 | ### TCP -> TCP 2255 | nc -l -p 2000 -c "nc [ip|hostname] 3000" 2256 | 2257 | ### TCP -> UDP 2258 | nc -l -p 2000 -c "nc -u [ip|hostname] 3000" 2259 | 2260 | ### UDP -> UDP 2261 | nc -l -u -p 2000 -c "nc -u [ip|hostname] 3000" 2262 | 2263 | ### UDP -> TCP 2264 | nc -l -u -p 2000 -c "nc [ip|hostname] 3000" 2265 | ``` 2266 | 2267 | ___ 2268 | 2269 | ##### Tool: [socat](http://www.dest-unreach.org/socat/doc/socat.html/) 2270 | 2271 | ###### Testing remote connection to port 2272 | 2273 | ```bash 2274 | socat - TCP4:10.240.30.3:22 2275 | ``` 2276 | 2277 | * `-` - standard input (STDIO) 2278 | * `TCP4:` - set tcp4 connection with specific params 2279 | * `[hostname|ip]` - set hostname/ip 2280 | * `[1-65535]` - set port number 2281 | 2282 | ###### Redirecting TCP-traffic to a UNIX domain socket under Linux 2283 | 2284 | ```bash 2285 | socat TCP-LISTEN:1234,bind=127.0.0.1,reuseaddr,fork,su=nobody,range=127.0.0.0/8 UNIX-CLIENT:/tmp/foo 2286 | ``` 2287 | 2288 | * `TCP-LISTEN:` - set tcp listen with specific params 2289 | * `[1-65535]` - set port number 2290 | * `bind=[hostname|ip]` - set bind hostname/ip 2291 | * `reuseaddr` - allows other sockets to bind to an address 2292 | * `fork` - keeps the parent process attempting to produce more connections 2293 | * `su=nobody` - set user 2294 | * `range=[ip-range]` - ip range 2295 | * `UNIX-CLIENT:` - communicates with the specified peer socket 2296 | * `filename` - define socket 2297 | 2298 | ___ 2299 | 2300 | ##### Tool: [lsof](https://en.wikipedia.org/wiki/Lsof) 2301 | 2302 | ###### Show process that use internet connection at the moment 2303 | 2304 | ```bash 2305 | lsof -P -i -n 2306 | ``` 2307 | 2308 | ###### Show process that use specific port number 2309 | 2310 | ```bash 2311 | lsof -i tcp:443 2312 | ``` 2313 | 2314 | ###### Lists all listening ports together with the PID of the associated process 2315 | 2316 | ```bash 2317 | lsof -Pan -i tcp -i udp 2318 | ``` 2319 | 2320 | ###### List all open ports and their owning executables 2321 | 2322 | ```bash 2323 | lsof -i -P | grep -i "listen" 2324 | ``` 2325 | 2326 | ###### Show all open ports 2327 | 2328 | ```bash 2329 | lsof -Pnl -i 2330 | ``` 2331 | 2332 | ###### Show open ports (LISTEN) 2333 | 2334 | ```bash 2335 | lsof -Pni4 | grep LISTEN | column -t 2336 | ``` 2337 | 2338 | ###### List all files opened by a particular command 2339 | 2340 | ```bash 2341 | lsof -c "process" 2342 | ``` 2343 | 2344 | ###### View user activity per directory 2345 | 2346 | ```bash 2347 | lsof -u username -a +D /etc 2348 | ``` 2349 | 2350 | ###### Show 10 Largest Open Files 2351 | 2352 | ```bash 2353 | lsof / | \ 2354 | awk '{ if($7 > 1048576) print $7/1048576 "MB" " " $9 " " $1 }' | \ 2355 | sort -n -u | tail | column -t 2356 | ``` 2357 | 2358 | ___ 2359 | 2360 | ##### Tool: [netstat](https://en.wikipedia.org/wiki/Netstat) 2361 | 2362 | ###### Graph # of connections for each hosts 2363 | 2364 | ```bash 2365 | netstat -an | \ 2366 | grep ESTABLISHED | \ 2367 | awk '{print $5}' | \ 2368 | awk -F: '{print $1}' | \ 2369 | grep -v -e '^[[:space:]]*$' | \ 2370 | sort | uniq -c | \ 2371 | awk '{ printf("%s\t%s\t",$2,$1) ; for (i = 0; i < $1; i++) {printf("*")}; print "" }' 2372 | ``` 2373 | 2374 | ###### Monitor open connections for specific port including listen, count and sort it per IP 2375 | 2376 | ```bash 2377 | watch "netstat -plan | grep :443 | awk {'print \$5'} | cut -d: -f 1 | sort | uniq -c | sort -nk 1" 2378 | ``` 2379 | 2380 | ___ 2381 | 2382 | ##### Tool: [rsync](https://en.wikipedia.org/wiki/Rsync) 2383 | 2384 | ###### Rsync remote data as root using sudo 2385 | 2386 | ```bash 2387 | rsync --rsync-path 'sudo rsync' username@hostname:/path/to/dir/ /local/ 2388 | ``` 2389 | 2390 | ___ 2391 | 2392 | ##### Tool: [host](https://en.wikipedia.org/wiki/Host_(Unix)) 2393 | 2394 | ###### Resolves the domain name (using external dns server) 2395 | 2396 | ```bash 2397 | host google.com 9.9.9.9 2398 | ``` 2399 | 2400 | ###### Checks the domain administrator (SOA record) 2401 | 2402 | ```bash 2403 | host -t soa google.com 9.9.9.9 2404 | ``` 2405 | 2406 | ___ 2407 | 2408 | ##### Tool: [dig](https://en.wikipedia.org/wiki/Dig_(command)) 2409 | 2410 | ###### Resolves the domain name (short output) 2411 | 2412 | ```bash 2413 | dig google.com +short 2414 | ``` 2415 | 2416 | ###### Lookup NS record for specific domain 2417 | 2418 | ```bash 2419 | dig @9.9.9.9 google.com NS 2420 | ``` 2421 | 2422 | ###### Query only answer section 2423 | 2424 | ```bash 2425 | dig google.com +nocomments +noquestion +noauthority +noadditional +nostats 2426 | ``` 2427 | 2428 | ###### Query ALL DNS Records 2429 | 2430 | ```bash 2431 | dig google.com ANY +noall +answer 2432 | ``` 2433 | 2434 | ###### DNS Reverse Look-up 2435 | 2436 | ```bash 2437 | dig -x 172.217.16.14 +short 2438 | ``` 2439 | 2440 | ___ 2441 | 2442 | ##### Tool: [network-other](https://github.com/trimstray/the-book-of-secret-knowledge#tool-network-other) 2443 | 2444 | ###### Get all subnets for specific AS (Autonomous system) 2445 | 2446 | ```bash 2447 | AS="AS32934" 2448 | whois -h whois.radb.net -- "-i origin ${AS}" | \ 2449 | grep "^route:" | \ 2450 | cut -d ":" -f2 | \ 2451 | sed -e 's/^[ \t]//' | \ 2452 | sort -n -t . -k 1,1 -k 2,2 -k 3,3 -k 4,4 | \ 2453 | cut -d ":" -f2 | \ 2454 | sed -e 's/^[ \t]/allow /' | \ 2455 | sed 's/$/;/' | \ 2456 | sed 's/allow */subnet -> /g' 2457 | ``` 2458 | 2459 | ###### Resolves domain name from dns.google.com with curl and jq 2460 | 2461 | ```bash 2462 | _dname="google.com" ; curl -s "https://dns.google.com/resolve?name=${_dname}&type=A" | jq . 2463 | ``` 2464 | 2465 | Programming 2466 | 2467 | ##### Tool: [awk](http://www.grymoire.com/Unix/Awk.html) 2468 | 2469 | ###### Remove duplicate entries in a file without sorting 2470 | 2471 | ```bash 2472 | awk '!x[$0]++' filename 2473 | ``` 2474 | 2475 | ###### Exclude multiple columns using AWK 2476 | 2477 | ```bash 2478 | awk '{$1=$3=""}1' filename 2479 | ``` 2480 | 2481 | ###### Get the last hour of Apache logs 2482 | 2483 | ```bash 2484 | awk '/'$(date -d "1 hours ago" "+%d\\/%b\\/%Y:%H:%M")'/,/'$(date "+%d\\/%b\\/%Y:%H:%M")'/ { print $0 }' /var/log/httpd/access_log 2485 | ``` 2486 | 2487 | ___ 2488 | 2489 | ##### Tool: [sed](http://www.grymoire.com/Unix/Sed.html) 2490 | 2491 | ###### To print a specific line from a file 2492 | 2493 | ```bash 2494 | sed -n 10p /path/to/file 2495 | ``` 2496 | 2497 | ###### Remove a specific line from a file 2498 | 2499 | ```bash 2500 | sed -i 10d /path/to/file 2501 | # alternative (BSD): sed -i'' 10d /path/to/file 2502 | ``` 2503 | 2504 | ###### Remove a range of lines from a file 2505 | 2506 | ```bash 2507 | sed -i -re ',d' 2508 | ``` 2509 | 2510 | ___ 2511 | 2512 | ##### Tool: [grep](http://www.grymoire.com/Unix/Grep.html) 2513 | 2514 | ###### Search for a "pattern" inside all files in the current directory 2515 | 2516 | ```bash 2517 | grep -rn "pattern" 2518 | grep -RnisI "pattern" * 2519 | fgrep "pattern" * -R 2520 | ``` 2521 | 2522 | ###### Remove blank lines from a file and save output to new file 2523 | 2524 | ```bash 2525 | grep . filename > newfilename 2526 | ``` 2527 | 2528 | ###### Except multiple patterns 2529 | 2530 | ```bash 2531 | grep -vE '(error|critical|warning)' filename 2532 | ``` 2533 | 2534 | ###### Show data from file without comments 2535 | 2536 | ```bash 2537 | grep -v ^[[:space:]]*# filename 2538 | ``` 2539 | 2540 | ###### Show data from file without comments and new lines 2541 | 2542 | ```bash 2543 | egrep -v '#|^$' filename 2544 | ``` 2545 | --------------------------------------------------------------------------------