Graybyt3 Was Here

Linux host1.absolutelystunningcenterpieces.com 3.10.0-957.21.3.el7.x86_64 #1 SMP Tue Jun 18 16:35:19 UTC 2019 x86_64
Apache
69.167.136.200

File Name : threads.txt

WARNING: This document is currently a stub. It is incomplete, but provided to
give a vague overview of how threads are implemented.

Multithreading in memcached *was* originally simple:

- One listener thread
- N "event worker" threads
- Some misc background threads

Each worker thread is assigned connections, and runs its own epoll loop. The
central hash table, LRU lists, and some statistics counters are covered by
global locks. Protocol parsing, data transfer happens in threads. Data lookups
and modifications happen under central locks.

THIS HAS CHANGED!

I do need to flesh this out more, and it'll need a lot more tuning, but it has
changed in the following ways:

- A secondary small hash table of locks is used to lock an item by its hash
  value. This prevents multiple threads from acting on the same item at the
  same time.
- This secondary hash table is mapped to the central hash tables buckets. This
  allows multiple threads to access the hash table in parallel. Only one
  thread may read or write against a particular hash table bucket.
- atomic refcounts per item are used to manage garbage collection and
  mutability.
- A central lock is still held around any "item modifications" - any change to
  any item flags on any item, the LRU state, or refcount incrementing are
  still centrally locked.

- When pulling an item off of the LRU tail for eviction or re-allocation, the
  system must attempt to lock the item's bucket, which is done with a trylock
  to avoid deadlocks. If a bucket is in use (and not by that thread) it will
  walk up the LRU a little in an attempt to fetch a non-busy item.

Since I'm sick of hearing it:

- If you remove the per-thread stats lock, CPU usage goes down by less than a
  point of a percent, and it does not improve scalability.
- In my testing, the remaining global STATS_LOCK calls never seem to collide.

Yes, more stats can be moved to threads, and those locks can actually be
removed entirely on x86-64 systems. However my tests haven't shown that as
beneficial so far, so I've prioritized other work. Apologies for the rant but
it's a common question.

System Information
*ReClick For Close
File : BlackDragon /wanderfuls/about.php

Name	Type	Size	Owner/Group	Permission	Last Modified	Actions
.	dir	-	root/root	0755	2019-06-29 02:09:50
..	dir	-	root/root	0755	2025-12-02 09:05:56
AUTHORS	file	69 B	root/root	0644	2012-01-06 06:19:50
CONTRIBUTORS	file	1.47 KB	root/root	0644	2012-01-06 06:19:50
COPYING	file	1.47 KB	root/root	0644	2009-08-29 11:00:58
ChangeLog	file	19.06 KB	root/root	0644	2011-07-10 07:46:58
NEWS	file	40 B	root/root	0644	2012-01-06 06:19:50
README.md	file	934 B	root/root	0644	2012-07-30 01:05:16
protocol.txt	file	34.19 KB	root/root	0644	2012-07-29 08:36:47
readme.txt	file	74 B	root/root	0644	2012-01-06 06:19:50
threads.txt	file	2.07 KB	root/root	0644	2012-09-03 10:17:10