admin

joined 1 year ago
[–] [email protected] 3 points 11 months ago

Can't blame you for that. Personally, I still think it excels at content where communication with OP is irrelevant, like [email protected], [email protected] or [email protected]. And by far best example of this, if you look at the subscriber count, is nsfw content.

[–] [email protected] 2 points 11 months ago

Nope. That would be very hard to implement, and probably very confusing and disliked by other lemmy users.

[–] [email protected] 4 points 11 months ago

I don’t know how the karma thresholds work behind the scenes, but might I suggest for the bot to do a “top for” sort instead? Like it will only repost top content for the past 6 hours only. This will also help get more quality content as well and avoid reposting low effort/quality posts.

This is effectively already kinda how it works. For each subreddit it periodically (anywhere between every 30 minutes to every 12 hours, based on subscriber count and posts per day) requests the "hot" content feed. It then checks each post if it has at least 20 upvotes, and a 80% upvote to downvote ratio. Those numbers are configurable, but that's what they're currently set to - I believe they're a good mix between filtering out the complete garbage while still making sure it doesn't miss good content is.

 

A few months ago, I launched the Lemmit instance and bot (@[email protected]). Primarily, this was to help me stay up to date with some of the content I'd leave behind on Reddi. Additionally, I wanted to give back to the community, so I made it possible for anyone to request the archiving of subreddits to the Lemmit instance.

However, this came with some unintended consequences. Notably, the most subscribed community on the instance has been [email protected]. Even though it should have been obvious that there is no way to communicate with the Original Poster, given they're on Reddit.

The pushback against the bot and the instance has increased over time. A recent post, This bot is bad for Lemmy, highlighted these concerns. I've also received similar feedback from admins of major Lemmy Instances and through direct PMs.

As a response, last week I stopped accepting requests for archiving new subreddits. This weekend, I went a step further by discontinuing the archiving of a large amount of "interactive subreddits"—communities primarily centered around Q&A or communication with the Original Poster. This includes subs like [email protected] and [email protected], as well as niche and support communities. Such discussions are better hosted on Reddit or Lemmy's equivalent spaces.

I've also adjusted the post karma thresholds to curb spam posts. While this probably won't appease everyone, it should reduce the bot's posting frequency.

Perhaps this might prompt some admins to rethink their choice to defederate from the Lemmit instance, or the banning of the bot. I'm not expecting anyone to, and won't take it personally if you don't, but I wanted to give the community this update nonetheless.

In [email protected] there's a sticky post of all the Actively archived communities on the server (including NSFW ones, since that is not public without logging in), as well as the list of communities for which archiving is now disabled.

Cheers!

0
List of communities. (lemmit.online)
submitted 11 months ago* (last edited 11 months ago) by [email protected] to c/[email protected]
 

Since it's impossible to see all the communities on here without logging in (mandatory NSFW filter), and I'm the only one with an account on here, here's a list of them. This list will be a snapshot, so the subscriber count will not be up to date, but I'm sure you'll figure it out.

Ident NSFW Subscribers
1000ccplus NSFW 14
2000ccplus NSFW 8
2007scape 13
2137 41
2meirl4meirl 29
2westerneurope4u 254
3dprinting 90
80sdesign 64
90sdesign 54
AskReddit 222
Boise 67
Erotica NSFW 153
IdiotsInCars 140
InternetIsBeautiful 73
MuseumOfReddit 71
PerfectlyCutMeows 54
ProgrammerHumor 275
SFWdeepfakes 57
Superstonk 295
Ultralight 85
abandonedporn 242
aboringdystopia 56
acmilan 26
adviceanimals 124
afterplayio 20
akaimpc 29
aleague 34
algarve 34
alternateangles 59
altgirls NSFW 362
amateurroomporn 11
amazonposition NSFW 62
anal NSFW 344
anal_yiff NSFW 50
analog 18
analogcommunity 20
androiddev 43
ani_bm 38
animalsbeingderps 15
anime 157
animemes 127
anormaldayinrussia 63
antimeme 15
antiwork 153
apksapps 45
apple 58
applevisionpro 35
appnotes 31
arizona 40
arizonatrail 51
armenia 8
arsenalwfc 30
artificial 10
artisanvideos 34
artsakh 7
asiansgonewild30plus NSFW 56
asiantraps NSFW 90
assettocorsa 8
atbge 6
audioproductiondeals 26
australia 40
autism 12
ayaneo 47
backyardfarmers 5
badscificovers 30
banano 33
bangmybully NSFW 32
bapcsalescanada 43
baseball 75
battlebots 54
battlestations 153
bbw NSFW 132
bbw_banging NSFW 18
bbwbutthole NSFW 50
bbwgw NSFW 33
bbwhardcore NSFW 75
bbwmilf NSFW 184
bbwtits NSFW 57
bdsm NSFW 70
bdsm_smiles NSFW 36
beamng 47
beautifulfemales 120
beefcurtains NSFW 70
beer 43
bestoflegaladvice 109
bestofredditorupdates 151
bicycletouring 42
bigareolalover NSFW 45
bigboobsgonewild NSFW 17
bigdickgirl NSFW 47
biggerbabes NSFW 34
bigtittygothgf NSFW 50
bikeporn 42
biketouring 43
biology 29
bioniclelego 22
blockedandreported 29
blunderyears 68
blursedimages 29
bmw 31
bobstavern 4
bois NSFW 129
bonnebouffe 9
boxing 38
brasil 47
brownchickswhitedicks NSFW 142
buildapcsales 156
burdurland 3
bustynaturals NSFW 275
buttsandbarefeet NSFW 198
cantonese 27
carpentry 5
cars 48
castiron 34
casualpt 39
celebhub 40
celebnsfw NSFW 199
celebnudedebut NSFW 55
celebritylegs 15
celebs 109
celebswithpetitetits 215
cfb 50
cfs 47
chastitycouples NSFW 81
chickflixxx NSFW 73
chloe 46
chubby NSFW 78
chubby_hentai NSFW 55
cirkeltrek 50
citiesskylines 122
citypop 53
codzombies 29
collapse 29
combatfootage 94
comedycemetery 7
comedyheaven 7
comedyhomicide 11
comedynecromancy 7
comedynecrophilia 10
comics 162
comicstriphistory 56
comicwalls 42
completeanarchy 4
condomtobarebackmfmt NSFW 34
coolguides 144
copypasta NSFW 17
corgigifs 7
coronavirus 51
couplesgonewildplus NSFW 33
cozyplaces 5
crackwatch 57
crboxes 34
creampie NSFW 46
cremposting 7
crossstitch 58
cruelcaptions NSFW 18
cryptocurrency 81
cuckold NSFW 158
cuckoldpregnancy NSFW 57
cuckoldstories2 NSFW 26
cumcoveredfucking NSFW 99
cumdumpsters NSFW 184
cumshotgifs NSFW 201
cumsluts NSFW 629
curatedtumblr 31
cursedcomments 65
daintywilderfans NSFW 41
dallas 48
dankmemes 28
daresgonewild NSFW 76
datahoarder 76
dataisbeautiful 364
dccomics 66
deadmau5 18
decor 3
deeprockgalactic 74
depthhub 33
destiny2 71
deusex 39
dewalt 8
dinosaure 5
discordvideos 8
diwhy 90
diwhynot 37
documentaries 69
dota2 73
dross NSFW 7
drugscirclejerk 59
edmonton 18
electricians 5
emogirlsfuck NSFW 402
enculerlesvoitures 10
engineeringporn 172
engorgedveinybreasts NSFW 127
entertainment 51
enterthegungeon 3
epicgamespc 55
erotichypnosis NSFW 66
eroticliterature NSFW 64
eu4 8
eu_nvr 23
everything_gripe 31
exmormon 58
extrafabulouscomics 24
extramile NSFW 213
eyebleach 90
facepalm 37
factorio 87
fairytaleasfuck 11
fakealbumcovers 36
fatwomenlove NSFW 42
fedora 91
feedthebeast 94
femboy 39
femboymemes 20
femboys NSFW 149
femboys4real NSFW 30
feral_yiff NSFW 41
feralpokeporn NSFW 49
fighters 6
fixedgearbicycle 52
flagporn 5
flatchests NSFW 88
food 124
forbiddensnacks 11
forgottenbookmarks 36
formula1 30
formuladank 133
fortcollins 39
fortyfivefiftyfive NSFW 247
fosscad 70
fossdroid 137
foundryvtt 32
framework 17
freegamefindings 118
frogbutt NSFW 115
functionalprint 103
funny 342
furry_irl 165
furryhits 30
futadomworld NSFW 7
fuzzypeeks NSFW 28
gadgets 53
gamedeals 212
gamedealsfree 82
games 164
gamingleaksandrumours 44
gardening 10
garfieldminusgarfield 42
gay_irl 10
gaytwerking NSFW 16
generative 31
genshin_impact 53
gentlemanboners 293
geocaching 37
germanshepherds 28
gfur NSFW 98
gfurcomics NSFW 16
ghosts 30
ghoststories 28
ginger NSFW 156
girlsfarting NSFW 8
girlsfinishingthejob NSFW 553
girlsjoy NSFW 105
girlsjustwanttobefuck NSFW 121
girlsmasturbating NSFW 239
girlswholovetobefuck NSFW 178
giscardpunk 9
globaloffensive 53
gme_meltdown 6
gmecanada 39
gnome 5
gocommitdie 7
godot 13
godpussy NSFW 401
gonemildplus NSFW 36
gonewild NSFW 508
gonewild30plus NSFW 424
gonewildaudio NSFW 254
gonewildchubby NSFW 89
gonewildcolor NSFW 40
gonewildhairy NSFW 29
gonewildplus NSFW 36
gonewildstories NSFW 278
goodanimemes 127
googleplaydeals 119
gooned NSFW 168
gothstyle 3
granturismo 33
gravelcycling 47
greenhouses 6
grimdank 70
grime 8
grool NSFW 120
guildwars 10
guildwars2 65
guiltygear 49
gunners 50
hackernews 18
hardware 53
haunted 29
havanese 31
hayastan 7
hearthstone 41
hentai NSFW 31
hentaihumiliation NSFW 75
hfy 58
highstrangeness 86
hmmm 5
hobbydrama 18
hockey 63
holdmybeer 7
hololive 57
holup 34
homeassistant 430
homedecorating 4
homelab 146
homelabsales 23
homestead 7
homesteading 8
honkaistarrail 22
horror 73
hotwifetexts NSFW 38
hoyas 40
humiliationcaptions NSFW 34
humongousaurustits NSFW 23
hyruleengineering 67
icecreamery 42
ich_iel 5
idm 5
imaginarybestof 77
imaginarywarhammer 72
impregnation NSFW 18
imsorryjon 26
imthemaincharacter 88
inceltear 48
incest_captions NSFW 104
incestsexstories NSFW 75
incorgnito 7
india 46
indonesia 6
interestingasfuck NSFW 40
interiordesign 4
iphone 68
itookapicture 314
jailbreak 38
japanese_adult_video NSFW 57
japantravel 22
jav NSFW 131
java 19
javdreams NSFW 49
jerkofftoceleb NSFW 58
karengillan 3
keep_track 30
kgbtr 35
kiernanshipka 3
kinkycaptions NSFW 23
koreannsfw NSFW 56
kpopfap NSFW 49
labiadangling NSFW 59
ladyladyboners 119
lasercutting 41
latvia 3
learncantonese 28
learnjapanese 17
legalcatadvice 32
leopardsatemyface 136
lesbianpov NSFW 69
lesbians NSFW 140
lifehacks 53
lifeprotips 138
link_dies 33
linustechtips 118
linux_gaming 225
liverpoolfc 32
livestreamfail 80
loveforboozecruisers 39
luxembourg 42
machinelearning 8
machineporn 40
mademesmile 93
magictcg 5
malelivingspace 60
maliciouscompliance 130
manga 79
mapporn 98
marchagainstnazis 87
margotrobbie 6
mathgifs 33
maybemaybemaybe 21
mazda3 36
mcmansionhell 54
me_irl 17
mealtimevideos 13
meirl 21
meme 14
memes 52
merdasdoolx 37
microsoft 43
middleeasternhotties NSFW 38
midjourney 80
mildlyinteresting 155
minecraft 5
misterfpga 7
mmgirls NSFW 81
modcoord 80
mommymilkersnsfw NSFW 152
monero 40
monstermusume 32
mortalkombat 52
mousereview 4
movieposterporn 63
movies 110
mpcusers 27
mre 32
musicthemetime 36
mylittlepony 7
mylittleredacted 10
nadinejansen NSFW 4
nanocurrency 42
natalee NSFW 11
nativeamericangirls2 NSFW 26
nba 57
neovim 14
newcastleupontyne 33
newzealand 83
nexdock 46
nextcloud 40
nfa 63
nfl 75
nicechips 34
nightofthefullmoon 25
nirvannatheband 6
nixos 42
noncredibledefense NSFW 10
nordictrackandroid 46
northkoreapics 27
nosleep 187
nostalgia 16
notkenm 36
nsfw_caption NSFW 105
nsfw_gif NSFW 308
nsfw_japan NSFW 85
nsfwcelebs NSFW 210
nsfwcosplay NSFW 148
nsfwcyoa NSFW 8
nudecelebsonly NSFW 102
nukedmemes 8
nyc 40
offgrid 11
offgridcabins 6
oilporn NSFW 106
okbuddyhololive 34
okbuddyphd 13
okbuddyretard 90
okdraudzindauni 3
onebag 14
onepiece 43
onepunchman 110
onguardforthee NSFW 53
onmww NSFW 63
onoffcelebs NSFW 84
opensource 77
opensourceapps 43
orgasms NSFW 116
osr 11
outmanga 10
owlhousemystery 5
paradoxplaza 5
paranormal 40
paranormalencounters 18
pastaemportugues 19
pathofexile 15
paymoneywubby 61
pcmasterrace 475
peloton 76
permaculture 9
perth 55
philadelphia 41
pillowtalkaudio NSFW 18
piracy 101
piracyarchive 42
plotterart 20
plumbing 5
plussizedhotwives2 NSFW 41
polandball 6
politicalcompassmemes 23
politicalhumor 55
polska 44
portugal 73
portugalcaralho 61
preggohentai NSFW 59
presscumference NSFW 67
prettygirls 144
prettygirlsuglyfaces 37
programminglanguages 43
projectceleste 36
pronebone NSFW 24
publicfreakout 106
pussywallet NSFW 56
quebec 59
quilting 46
raining 44
rance 13
randonneuring 23
rareinsults 36
rarepuppers 21
realcivilengineer 41
redlettermedia 46
redneckengineering 83
retroussetits NSFW 146
rg35xx 23
riae_ NSFW 10
riaesuicide NSFW 15
rickandmorty 17
ringfitadventure 2
roms 50
roomporn 5
rpclipsgta 44
rpi 39
rule34 NSFW 331
running 8
rust 36
sailing 5
salmacian 5
samsungdex 51
save3rdpartyapps 6
sbcgaming 24
scams NSFW 8
science 107
sdforall 36
sdnsfw NSFW 286
selfhosted 157
seltinsweety NSFW 48
sffpc 61
sfwredheads 92
sharktits NSFW 24
shecame NSFW 47
shefuckshim NSFW 382
shegothands 48
shibbysays NSFW 47
shitposting 16
shorthairchicks NSFW 137
shorthairedwaifus 52
simpsonsshitposting 110
singularity 140
sissyinspiration NSFW 54
sissyperfection NSFW 79
skamtebord 8
skiing 28
slimthick NSFW 55
slink NSFW 16
slutoon NSFW 31
sluttyconfessions NSFW 92
smallboobs NSFW 208
soccer 64
solardiy 5
solaropposites 12
solidworks 23
sonicporn NSFW 20
sonicthehedgehog 65
space 101
spanking NSFW 21
specializedtools 61
speedrun 61
spicykittens 29
squaredcircle 96
stablediffusion 95
starcraft 49
stationeers 37
steamdeals 192
steamdeck 266
stevenuniverse 54
stihl 5
stolendogbeds 24
strapon NSFW 144
strava 37
stuffers NSFW 8
submechanophobia 54
suctiondildos NSFW 53
surface 39
sweatypalms 12
sweden 16
swiftui 13
swtor 51
taboocaptions NSFW 60
talesfromretail 34
talesfromtechsupport 53
tasker 54
tech 74
technicallythetruth 70
technology 163
techsupportgore 16
telegrambots 38
television 148
tentai NSFW 106
teslamotors 46
tf_irl 45
thalassophobia 49
thanksihateit 8
thedeprogram 95
thegrandtour 34
thenetherlands 57
theowlhouse 7
therewasanattempt 95
therian 42
thick NSFW 110
thisismylifemeow NSFW 15
thisismylifenow 38
thomastheplankengine 43
threesome NSFW 192
throatpies NSFW 38
tifu 412
tihi 8
tiktokchallenge NSFW 25
tiktokthots NSFW 164
tili 2
tinyawoos 7
titanfall 32
todayilearned 786
transformation NSFW 51
transmedical 35
traps NSFW 148
truefmk NSFW 31
truescarystories 25
truespotify 15
truscum 52
tucson 56
turkeyjerky 5
tvplus 38
twinks NSFW 135
twisthearthstone 4
u_icky_peach NSFW 10
ufo 42
ufos 130
ukraine 131
ukrainewarvideoreport 40
ukrainianconflict 203
unbgbbiivchidctiicbg 117
undertoys NSFW 25
unexpected 76
unfilteredcaptions NSFW 19
unixporn 74
unixsocks 40
upliftingnews 107
vegetablegardening 34
videos 35
vim 7
visionpro 43
vore NSFW 6
vxjunkies 23
vyos 26
wagnervsrussia 16
wallstreetbets 8
walmart 12
washingtondc 38
watchitfortheplot NSFW 120
weightlifting 47
weightroom 23
wetpussys NSFW 512
wholesomeyuri 86
whoopsgoesthecondom NSFW 24
widaczabory 7
wildhearthstone 3
windsynth 27
woodworking 13
wordsonanimegirls 7
worldnews 593
wow 51
wowservers 32
wroclaw 28
wrx 45
wtf 51
xsome NSFW 210
yiff NSFW 159
yiffbondage NSFW 32
yiffcomics NSFW 42
youseeingthisshit 44
youtubedrama 36
yuri NSFW 48
yuri_jp 42
zeldass NSFW 67
zillowgonewild 27
ziplyfiber 25
0
submitted 1 year ago* (last edited 11 months ago) by [email protected] to c/[email protected]
 

In the short time since this instance and bot launched, I've been seeing the same questions resurface multiple times. This is totally understandable, since the concept of a Fediverse is still new to most (myself included), and this server is not like the others.

Q: What is Lemmit?

A: Lemmit is a Lemmy instance specifically designed for archiving Reddit content. Users can request new subreddits to be included in the archiving process by posting in the [email protected] community. It is powered by an open source python bot, which periodically checks the request list, adds new requests to the queue, and continuously monitors the Hot feed of those subs for new posts to cross-post here.

Q: Does it synchronize comments?

A: No, that would be impossible. Considering there are thousands of posts already on Lemmit, many of them having at least several hundred comments on Reddit, often buried in deep layers, it simply wouldn't be feasible to index those for more than a few posts, let alone keep them up to date.

Unfortunately, this means that archiving certain subreddits, such as Ask Historians/Men/Women/Hyperintelligentshadesofthecolourblue-type subs, is going to be rather pointless.

Q: Can it send comments back to Reddit?

A: No, it cannot. The purpose is to help bootstrap the Lemmy platform, not to serve as a bridge between the two networks. Also, see the answer about synchronizing comments.

Q: Can I request any subreddit?

A: ~~Technically, yes. However, as the list of subs grows, the time it takes to update all of them will also increase. I do not have strict guidelines in place for this, so I'm relying on your common sense (hoooo boy). At some point, I will probably have to either stop accepting new requests or disable scraping for very low-traffic communities.~~ Nope. Automatic requests for new subreddits are closed. You can send me a PM if you think a specific subreddit would be a valuable addition to the Lemmyverse, but you'll have to make a strong case.

Q: Does this use the API? Will it keep working after July 1st?

A: Nope, it uses a combination of the public feed and scraping old.reddit.com. So, as long as those are still available, it will continue working. And even if they close those sources, there will probably be new ways to achieve the same effect. "Content, eh, finds a way."

Q: This is spam, can you stop?

A: First of all, I apologise for the inconvenience. All you have to do is block @[email protected], and none of its posts will ever show up on your instance. If you you don't want anyone else on your server to be exposed to this bot/instance, you should convince your admin to defederate from lemmit.online. Since there are no other users on here, there will be no harm done.

Obviously I could stop, because running this server and software is only ever going to cost me time and money. But for the reasons listed above, I still think this server is a useful addition to the lemmyverse at this time. But I'm looking forward to the day where I can turn the bot off because it's no longer needed.

Q: What started this?

A: Okay, nobody asked this, but I'm going to tell you anyway. After Reddit made it clear that they are effectively killing third-party apps and implementing plenty of other anti-end user decisions, I realized that I would either have to accept not being able to access my time-wasting content or have to do so in a rather uncomfortable way (either through the official app or old.reddit.com for as long as they'll allow it to exist).

Being a stubborn developer, naturally, I chose option C: Have my own Reddit. With blackjack, and hookers. This way, I would still be able to access my beloved content without being beholden to Reddit's mood swings and abusive relationship tendencies.

Besides that, I also know that Content is King. So I'm order to counter the network effect (No users because no content, No content because no users), I figured it would be better to have some inorganic content to bootstrap the adoption of Lemmy.

Q: Are NSFW subreddits allowed?

A: Absolutely. Like I said: Blackjack and hookers.

Q: My request isn't picked up by the bot!

A: That isn't a question. ~~But yeah, the process isn't flawless yet. I'm trying to iron out all the bugs as I encounter them. In the meantime, feel free to re-request the subreddit by making a second post. No harm done.~~ New subreddit requests are closed for the time being.

Q: No new posts are showing up at all on Lemmit

A: If no posts are appearing on the Lemmit Frontpage (sorted by NEW), it's possible that the bot has crashed or is stuck on something. Since no software is flawless, this sometimes happens. I usually fix this as soon as I'm aware, and I'm happy to say that these kinds of fatal errors are becoming less and less frequent. However, they may still occur, and as a human with needs of sleep and other responsibilities, I'm not always able to fix them immediately.

Q: Posts aren't showing up on my instance, what's up?

A: Due to the spammy nature of the bot, some server admins choose to block this server, and that is completely understandable. So first of all, make sure to check the instances link in the footer of your home server. If Lemmit is the Blocked Instances list, you're out of luck.

When you have verified that Lemmit is not blocked on your instance, try unsubscribing, waiting a little, and then re-subscribing. That tends to fix things.

 

I have created some software that is capable of synchronising posts from Reddit to Lemmy. It's still a little rough around the edges, but it works as a such:

People can request new subreddits to be mirrored on [email protected]. A bot (open source) will monitor the threads there, and if it finds a new request for a subreddit, it will make a new community on the Lemmit server, and add it to its monitored list. It will then make periodic checks to see if any new posts (it doesn't copy any comments) have been posted on reddit, and copy those over.

Users can then subscribe to those communities from their own lemmy instance, and from there federation will pick it up. Or at least, that's the theory. At the moment, federation is not working awesomely, and that is where my lack of fediverse knowledge comes in. Maybe it needs more time, or something is not so properly - I don't know.

Furthermore: registrations on this server are closed. The point of this service is not to become a community on its own, but to deliver, ehh, "original" content to all the rest of the Fediverse while it's going through a ramp-up phase. Besides, the instance is running on a pretty small vps, and I rather have this thing manage itself. There is a [email protected] community for further questions about the project itself though, in case people want to discuss it further.

So ehm... Let me know what you think :)