trAvis - MANAGER
Edit File: persistent.html
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <title>A persistent message — Varnish version 5.2.1 documentation</title> <link rel="stylesheet" href="../_static/classic.css" type="text/css" /> <link rel="stylesheet" href="../_static/pygments.css" type="text/css" /> <script type="text/javascript"> var DOCUMENTATION_OPTIONS = { URL_ROOT: '../', VERSION: '5.2.1', COLLAPSE_INDEX: false, FILE_SUFFIX: '.html', HAS_SOURCE: true }; </script> <script type="text/javascript" src="../_static/jquery.js"></script> <script type="text/javascript" src="../_static/underscore.js"></script> <script type="text/javascript" src="../_static/doctools.js"></script> <link rel="index" title="Index" href="../genindex.html" /> <link rel="search" title="Search" href="../search.html" /> <link rel="top" title="Varnish version 5.2.1 documentation" href="../index.html" /> <link rel="up" title="Poul-Hennings random outbursts" href="index.html" /> <link rel="next" title="Raking in the dough on Free and Open Source Software" href="dough.html" /> <link rel="prev" title="SSL revisited" href="ssl_again.html" /> </head> <body role="document"> <div class="related" role="navigation" aria-label="related navigation"> <h3>Navigation</h3> <ul> <li class="right" style="margin-right: 10px"> <a href="../genindex.html" title="General Index" accesskey="I">index</a></li> <li class="right" > <a href="dough.html" title="Raking in the dough on Free and Open Source Software" accesskey="N">next</a> |</li> <li class="right" > <a href="ssl_again.html" title="SSL revisited" accesskey="P">previous</a> |</li> <li class="nav-item nav-item-0"><a href="../index.html">Varnish version 5.2.1 documentation</a> »</li> <li class="nav-item nav-item-1"><a href="index.html" accesskey="U">Poul-Hennings random outbursts</a> »</li> </ul> </div> <div class="document"> <div class="documentwrapper"> <div class="bodywrapper"> <div class="body" role="main"> <div class="section" id="a-persistent-message"> <span id="phk-pesistent"></span><h1>A persistent message<a class="headerlink" href="#a-persistent-message" title="Permalink to this headline">¶</a></h1> <p>This message is about -spersistent and why you should not use it, even though it is still present in Varnish 4.x.</p> <div class="section" id="tl-dr"> <h2>TL;DR:<a class="headerlink" href="#tl-dr" title="Permalink to this headline">¶</a></h2> <p>Under narrow and ill defined circumstances, -spersistent works well, but in general it is more trouble than it is worth for you to run it, and we don't presently have the development resources to fix that.</p> <p>If you think you have these circumstances, you need to specify</p> <blockquote> <div>-sdeprecated_persistent</div></blockquote> <p>in order to use it.</p> </div> <div class="section" id="the-long-story"> <h2>The long story<a class="headerlink" href="#the-long-story" title="Permalink to this headline">¶</a></h2> <p>When we added -spersistent, to Varnish, it was in response to, and sponsored by a specific set of customers who really wanted this.</p> <p>A persistent storage module is an entirely different kettle of vax than a non-persistent module, because of all the ugly consistency issues it raises.</p> <p>Let me give you an example.</p> <p>Imagine a cluster of some Varnish servers on which bans are used.</p> <p>Without persistent storage, if one of them goes down and comes back up, all the old cached objects are gone, and so are, by definition all the banned objects.</p> <p>With persistent storage, we not only have to store the still live bans with the cached objects, and keep the two painfully in sync, so the bans gets revived with the objects, we also have to worry about missing bans during the downtime, since those might ban objects we will recover on startup.</p> <p>Ouch: Straight into database/filesystem consistency territory.</p> <p>But we knew that, and I thought I had a good strategy to deal with this.</p> <p>And in a sense I did.</p> <p>Varnish has the advantage over databases and filesystems that we can actually loose objects without it being a catastrophe. It would be better if we didn't, but we can simply ditch stuff which doesn't look consistent and we'll be safe.</p> <p>The strategy was to do a "Log Structured Filesystem", a once promising concept which soon proved very troublesome to implement well.</p> <p>Interestingly, today the ARM chip in your SSD most likely implements a LFS for wear-levelling, but with a vastly reduced feature set: All "files" are one sector long, filenames are integers and there are no subdirectories or rename operations. On the other hand, there is extra book-keeping about the state of the flash array.</p> <p>A LFS consists of two major components: The bit that reads and writes, which is pretty trivial, and the bit which makes space available which isn't.</p> <p>Initially we didn't even do the second part, because in varnish objects expire, and provided they do so fast enough, the space will magically make itself available. This worked well enough for our initial users, and they only used bans sporadically so that was cool too.</p> <p>In other words, a classic 20% effort, 80% benefit.</p> <p>Unfortunately we have not been able to find time and money for the other 80% effort which gives the last 20% benefit, and therefor -spersistent has ended up in limbo.</p> <p>Today we decided to officially deprecate -spersistent, and start warning people against using it, but we will leave it in the source code for now, in order to keep the interfaces necessary for a persistent storage working, in the hope that we will get to use them again later.</p> <p>So you can still use persistent storage, if you really want to, and if you know what you're doing, by using:</p> <blockquote> <div>-sdeprecated_persistent</div></blockquote> <p>You've been warned.</p> <p>Poul-Henning, 2014-05-26</p> </div> </div> </div> </div> </div> <div class="sphinxsidebar" role="navigation" aria-label="main navigation"> <div class="sphinxsidebarwrapper"> <h3><a href="../index.html">Table Of Contents</a></h3> <ul> <li><a class="reference internal" href="#">A persistent message</a><ul> <li><a class="reference internal" href="#tl-dr">TL;DR:</a></li> <li><a class="reference internal" href="#the-long-story">The long story</a></li> </ul> </li> </ul> <h4>Previous topic</h4> <p class="topless"><a href="ssl_again.html" title="previous chapter">SSL revisited</a></p> <h4>Next topic</h4> <p class="topless"><a href="dough.html" title="next chapter">Raking in the dough on Free and Open Source Software</a></p> <div role="note" aria-label="source link"> <h3>This Page</h3> <ul class="this-page-menu"> <li><a href="../_sources/phk/persistent.txt" rel="nofollow">Show Source</a></li> </ul> </div> <div id="searchbox" style="display: none" role="search"> <h3>Quick search</h3> <form class="search" action="../search.html" method="get"> <div><input type="text" name="q" /></div> <div><input type="submit" value="Go" /></div> <input type="hidden" name="check_keywords" value="yes" /> <input type="hidden" name="area" value="default" /> </form> </div> <script type="text/javascript">$('#searchbox').show(0);</script> </div> </div> <div class="clearer"></div> </div> <div class="related" role="navigation" aria-label="related navigation"> <h3>Navigation</h3> <ul> <li class="right" style="margin-right: 10px"> <a href="../genindex.html" title="General Index" >index</a></li> <li class="right" > <a href="dough.html" title="Raking in the dough on Free and Open Source Software" >next</a> |</li> <li class="right" > <a href="ssl_again.html" title="SSL revisited" >previous</a> |</li> <li class="nav-item nav-item-0"><a href="../index.html">Varnish version 5.2.1 documentation</a> »</li> <li class="nav-item nav-item-1"><a href="index.html" >Poul-Hennings random outbursts</a> »</li> </ul> </div> <div class="footer" role="contentinfo"> © Copyright 2010-2014, Varnish Software AS. Created using <a href="http://sphinx-doc.org/">Sphinx</a> 1.4.9. </div> </body> </html>