• XSS.stack #1 – первый литературный журнал от юзеров форума

NOSQL Zero Trust Search Engine (running website)

Отслеживать

barzifurze

RAID-массив
Пользователь
Регистрация
02.06.2020
Сообщения
94
Реакции
461
Zero Trust Search Engine

This site got shut down search.illicit.services

The tools are released for free

I hope someone will publish an educational video for friends about creating a site using this tool, which will help many users.

search.illicit.services



Zero Trust Search Engine​

This repository contains all the code nessecary to create your own version of https://search.0t.rocks.

Quickstart​

To get your search engine running quickly on a single Linux host:
  1. Install Docker with Docker Compose
  2. Run docker compose build; docker compose up
  3. Run bash start.sh
  4. Visit http://your-ip:3000

Converting Data​

This is the hard part and completely up to you. You need to convert data into a standard format before it can be imported. See sample.json for the example data.

Importing Data​

Data imports are done using the SimplePostTool included with Solr. You can download a copy of the binary release here, and import data with the following command after extracting Solr: bin/post -c BigData -p 8983 -host <your host> path/to/your/file
Docs are available here: https://solr.apache.org/guide/solr/latest/indexing-guide/post-tool.html

Making Changes​

If you make changes to code in the "dataapp" directory, you can re-build your app by re-running step 1 of Quickstart.

Considerations / Warnings​

  • Solr is very complex. If you intend on extending on the existing schema or indexing large quantities (billions) of documents, you will want to learn more about how it works.
  • Keep backups, things will go wrong if you deviate the standard path.
  • Don't be evil.

 
Пожалуйста, обратите внимание, что пользователь заблокирован
crockett сказал(а):
This is f*ed up. This search engine was too good.
Agreed. Was like the open source version of Have I Been Pwned. I am expecting another site to rise from illicit.services' ashes
 
Пожалуйста, обратите внимание, что пользователь заблокирован

Converting Data​

This is the hard part and completely up to you. You need to convert data into a standard format before it can be imported. See sample.json for the example data.


the 7.6 billion records were only around 1.2TB, he was using 8 - 250 GB disks or one 250 GB disk per 1.1Billion records , according to him the initial setup cost was 1000$ and monthly cost was 50$

if anyone could write a script to Convert the data to that specialized format, we might be able to create one. This was one of my favorite websites too.
 
Cyc199_77 сказал(а):

Converting Data​

This is the hard part and completely up to you. You need to convert data into a standard format before it can be imported. See sample.json for the example data.


the 7.6 billion records were only around 1.2TB, he was using 8 - 250 GB disks or one 250 GB disk per 1.1Billion records , according to him the initial setup cost was 1000$ and monthly cost was 50$

if anyone could write a script to Convert the data to that specialized format, we might be able to create one. This was one of my favorite websites too.
Cost is not important
Only a tutorial on setup and file conversion structure is needed
 
Последнее редактирование:
Пожалуйста, обратите внимание, что пользователь заблокирован
barzifurze сказал(а):
Zero Trust Search Engine
have u tried launching it, i am getting problems with solr, its a completely new thing for me , have u made any progress we can help each other.
 
LeakCheck сказал(а):
You can use our service, available at https://leakcheck.io. On the market since 2018.
We are committed to privacy and support hashed queries, and we don't store any search logs.
Search by email, username, keyword, company domain name and password.
It's down?
 
admin


Напишите ответ...
  • Вставить:
Прикрепить файлы
Верх