Mr Mirchi Posted June 21, 2023 Report Share Posted June 21, 2023 tell me this...spring based micro services lo DB design 3 services vunnavi...connected to their own schems...1 to 1 lekkana service 1(uses schema 1) lo user table vundhi ... id (identity column, PK) name ,email, unique account id. Service 2 lo and service 3 lo account id avasaram...ippudu account id ye ikkada use cheyatam better aaa in (schema 2 and schema 3) or id(from schema 1) column value better. db design appudu Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted June 22, 2023 Author Report Share Posted June 22, 2023 3 hours ago, Mr Mirchi said: tell me this...spring based micro services lo DB design 3 services vunnavi...connected to their own schems...1 to 1 lekkana service 1(uses schema 1) lo user table vundhi ... id (identity column, PK) name ,email, unique account id. Service 2 lo and service 3 lo account id avasaram...ippudu account id ye ikkada use cheyatam better aaa in (schema 2 and schema 3) or id(from schema 1) column value better. db design appudu account id reference is better... keep id as identity and auto increments only... Quote Link to comment Share on other sites More sharing options...
Mr Mirchi Posted June 22, 2023 Report Share Posted June 22, 2023 55 minutes ago, dasari4kntr said: account id reference is better... keep id as identity and auto increments only... why account id ref in another db.schema..why not id..kind of pk/fk la wok avudhi kadhaa...if acct id needs to be updated for any reason..we can do only in user table kadhaaaa Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted June 22, 2023 Author Report Share Posted June 22, 2023 10 hours ago, Mr Mirchi said: why account id ref in another db.schema..why not id..kind of pk/fk la wok avudhi kadhaa...if acct id needs to be updated for any reason..we can do only in user table kadhaaaa generally concurrency issues vastayi ani avoid chestaru… another thing is design…auto increments are numbers…during maintenance or backup restores… if seed reset happens…your system doesn’t work… Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted June 23, 2023 Author Report Share Posted June 23, 2023 1 Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted July 4, 2023 Author Report Share Posted July 4, 2023 SPACE TITLE: HOW TO GET YOUR FIRST JOB IN TECH AS A DEVELOPER... i didnt listen full...hope it might give good ideas about interviews and process... Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted July 5, 2023 Author Report Share Posted July 5, 2023 devops materials google drive... https://drive.google.com/drive/folders/1-qLMnwCWx7GAnkYSCV3CpwQDfVgY92Sc Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted July 6, 2023 Author Report Share Posted July 6, 2023 What is a 𝗩𝗲𝗰𝘁𝗼𝗿 𝗗𝗮𝘁𝗮𝗯𝗮𝘀𝗲? With the rise of Foundational Models, Vector Databases skyrocketed in popularity. The truth is that a Vector Database is also useful outside of a Large Language Model context. When it comes to Machine Learning, we often deal with Vector Embeddings. Vector Databases were created to perform specifically well when working with them: Storing. Updating. Retrieving. When we talk about retrieval, we refer to retrieving set of vectors that are most similar to a query in a form of a vector that is embedded in the same Latent space. This retrieval procedure is called Approximate Nearest Neighbour (ANN) search. A query here could be in a form of an object like an image for which we would like to find similar images. Or it could be a question for which we want to retrieve relevant context that could later be transformed into an answer via a LLM. Let’s look into how one would interact with a Vector Database: 𝗪𝗿𝗶𝘁𝗶𝗻𝗴/𝗨𝗽𝗱𝗮𝘁𝗶𝗻𝗴 𝗗𝗮𝘁𝗮. 1. Choose a ML model to be used to generate Vector Embeddings. 2. Embed any type of information: text, images, audio, tabular. Choice of ML model used for embedding will depend on the type of data. 3. Get a Vector representation of your data by running it through the Embedding Model. 4. Store additional metadata together with the Vector Embedding. This data would later be used to pre-filter or post-filter ANN search results. 5. Vector DB indexes Vector Embedding and metadata separately. There are multiple methods that can be used for creating vector indexes, some of them: Random Projection, Product Quantization, Locality-sensitive Hashing. 6. Vector data is stored together with indexes for Vector Embeddings and metadata connected to the Embedded objects. 𝗥𝗲𝗮𝗱𝗶𝗻𝗴 𝗗𝗮𝘁𝗮. 7. A query to be executed against a Vector Database will usually consist of two parts: Data that will be used for ANN search. e.g. an image for which you want to find similar ones. Metadata query to exclude Vectors that hold specific qualities known beforehand. E.g. given that you are looking for similar images of apartments - exclude apartments in a specific location. 8. You execute Metadata Query against the metadata index. It could be done before or after the ANN search procedure. 9. You embed the data into the Latent space with the same model that was used for writing the data to the Vector DB. 10. ANN search procedure is applied and a set of Vector embeddings are retrieved. Popular similarity measures for ANN search include: Cosine Similarity, Euclidean Distance, Dot Product. Some popular Vector Databases: Pinecone, Weviate, Milvus, Vespa. -------- Follow me to upskill in #MLOps, #MachineLearning, #DataEngineering, #DataScience and overall #Data space. Quote Link to comment Share on other sites More sharing options...
Spartan Posted July 7, 2023 Report Share Posted July 7, 2023 1 1 Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted July 10, 2023 Author Report Share Posted July 10, 2023 Quote Link to comment Share on other sites More sharing options...
Spartan Posted July 13, 2023 Report Share Posted July 13, 2023 https://www.confluent.io/blog/data-dichotomy-rethinking-the-way-we-treat-data-and-services/ Quote Link to comment Share on other sites More sharing options...
csrcsr Posted July 18, 2023 Report Share Posted July 18, 2023 Rofl https://www.instagram.com/reel/CumThdngV-Z/?igshid=MzRlODBiNWFlZA== Quote Link to comment Share on other sites More sharing options...
Vaaampireee Posted July 25, 2023 Report Share Posted July 25, 2023 learn python and Java programming skill . don't work on cheap bi and QA jobs Quote Link to comment Share on other sites More sharing options...
*Prince Charming Posted July 26, 2023 Report Share Posted July 26, 2023 @dasari4kntr any SDET tech learning roadmap available? Quote Link to comment Share on other sites More sharing options...
dasari4kntr Posted July 26, 2023 Author Report Share Posted July 26, 2023 1 hour ago, *Prince Charming said: @dasari4kntr any SDET tech learning roadmap available? will ping you...once i come across about it anywhere.. Quote Link to comment Share on other sites More sharing options...
.thumb.gif.343fe49c7e1c507ae0056326bd8cf77e.gif)
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.