Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Paper • 1908.10084 • Published • 13
How to use simonosgoode/nomic_embed_fine_tune_law_1.5 with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("simonosgoode/nomic_embed_fine_tune_law_1.5", trust_remote_code=True)
sentences = [
"cluster: SUMMARY: D Souza v. Canada (Citizenship and Immigration)\nCourt (s) Database\nFederal Court Decisions\nDate\n2021-12-16\nNeutral citation\n2021 FC 1430\nFile numbers\nIMM-6744-19\nDecision Content\nDate: 20211216\nDocket: IMM-6744-19\nCitation: 2021 FC 1430\nOttawa, Ontario, December 16, 2021\nPRESENT: The Honourable Mr. Justice Favel\nBETWEEN:\nRESHMA ANITHA D SOUZA\nApplicant\nand\nTHE MINISTER OF CITIZENSHIP AND IMMIGRATION\nRespondent\nJUDGMENT AND REASONS\nI. Nature of the Matter\n[1] The Applicant seeks judicial review of a November 5, 2019 re-determination decision [Decision] of a visa officer [Officer] pursuant to section 72 of the Immigration and Refugee Protection Act, SC 2001, c 27 [IRPA]. The Officer refused the Applicant’s application for a temporary resident visa and work permit [the Application] because the Officer was not satisfied that the Applicant’s offer of employment [Employment Offer] was genuine.\n[2] The application for judicial review is allowed.\nII. Background\n[3] The Applicant is a citizen of India. In December 2018, the Applicant submitted her Application to work as an in-home child caregiver in Calgary, Alberta. At the time, she was working in the United Arab Emirates. Her Application was based on a positive Labour Market Impact Assessment issued to her prospective employers [Prospective Employers].\n[4] In September 2018, the Applicant and the Prospective Employers signed a two-year employment contract, which they subsequently amended to reflect slightly less hours of work. The Prospective Employers’ two children were 8 and 15 years old at the time. In May 2019, the Application was refused. In July 2019, the Applicant applied for leave and for judicial review of the initial refusal. In September 2019, the Applicant agreed to discontinue her application for leave and for judicial review and the Respondent agreed to have another officer re-determine the Application.\n[5] On re-determination, the Officer requested further information from the Prospective Employers. The Applicant’s legal counsel submitted a September 20, 2019 letter [Legal Counsel’s Letter], in which they provided several documents, including a written employment offer addressed to the female Prospective Employer, updated Notices of Assessment [NOA], and the Applicant’s Employment Offer containing salary details. Ultimately, the Officer refused the Application because he was not satisfied that the Applicant’s Employment Offer was genuine.\nIII. The Decision\n[6] The Decision consists of a letter dated November 5, 2019 and the accompanying Global Case Management System notes. The Officer determined that the Employment Offer was not genuine. The Officer was not satisfied that the Employment Offer was consistent with the Prospective Employer’s reasonable needs. Further, he was not satisfied that the Prospective Employers could support the Employment Offer.\n[7] In the earlier application, the Prospective Employers indicated that the female Prospective Employer had turned down employment because they were not able to find childcare. In response to the Officer’s request for additional information, Legal Counsel’s Letter provided submissions in support of the Application and provided, among other requested information, the female Prospective Employer’s written job offer dated October 25, 2018. The Officer mistakenly states the job offer is dated October 25, 2019. The Officer questioned why the Prospective Employers did not provide any job offers prior to the Officer’s request. The Officer suggested that this indicated that the female Prospective Employer’s search for work began only after the Officer requested evidence of job offers.\n[8] The Officer considered the Prospective Employers’ two most recent NOAs that showed an annual income of $81,423 and $79,717. The Officer took the higher number and added the female Prospective Employer’s benefits of $5,861. The Officer determined that the Prospective Employers would be left with an income of approximately $65,000 after paying the Applicant’s $27,300 salary. The Officer determined that $65,000 is not a reasonable income to live off, particularly when compared to the benefits of retaining an additional $30,000. The Officer concluded that this was evidence that the Prospective Employers may not be able to fulfill the terms of the Employment Offer.\n[9] With regard to the reasonable needs of the Prospective Employers, the Officer considered the age of their children and their need to hire a childcare provider. The Prospective Employers raised the best interests of the child, but the Officer found they provided little evidence of how the Applicant would improve the interests of the children. For example, the Officer noted that the Prospective Employers indicated that they needed a childcare provider to keep their 16-year-old out of trouble. However, there were few details of what trouble they expected or how a new caregiver would have more success than the teenager’s parents in dealing with a teenager. The Officer further found that it was unclear why the 16-year-old could not supervise the nine-year-old, especially given the costs of childcare.\nIV. Issues and Standard of Review\n[10] The issues in this case are:\n(1) Is the Decision reasonable?\n(2) Should the Court enter an indirect substitution or make a cost order in favour of the Applicant?\n[11] The first issue does not engage one of the exceptions set out in Canada (Minister of Citizenship and Immigration) v Vavilov, 2019 SCC 65 [Vavilov] and is therefore reviewable on the standard of reasonableness (Vavilov at paras 16-17, 23-25). In assessing the reasonableness of a decision, the Court must consider both the outcome and the underlying rationale to assess whether the “decision as a whole is transparent, intelligible and justified” (Vavilov at para 15). For a decision to be reasonable, a decision-maker must adequately account for the evidence before it and be responsive to the Applicant’s submissions (Vavilov at paras 89-96, 125-128).\n[12] There is no standard of review for the second issue.\nV. Preliminary Matter\n[13] At the hearing, the Respondent submitted a supplementary Certified Tribunal Record for filing. The Applicant did not object. The Court accepts it for filing.\nVI. Parties’ Positions and Analysis\nA. Is the Decision reasonable?\n(1) Applicant’s Position\n[14] The Officer misread or overlooked evidence that was material to the female Prospective Employer’s work situation. First, it was unreasonable for the Officer to conclude that the female Prospective Employer would refuse job offers. The Officer unreasonably speculated that in many families, both parents work without a caregiver. Furthermore, when the Officer reviewed the female Prospective Employer’s job offer he mistakenly said the date was October 25, 2019 when it was actually October 25, 2018. The Officer then questioned why the Prospective Employers had not provided earlier job offers. Finally, the Officer failed to account for the Prospective Employers explanation that she only had one written job offer because the rest were verbal.\n[15] Second, the Officer failed to consider that the male Prospective Employer travels extensively for work. This led the Officer to generalize about his ability to assist his wife. This generalization had no basis in the record.\n[16] Third, the Officer stated that the Prospective Employers failed to explain the reduction in work hours. This indicates that the Officer overlooked the letters from the Prospective Employers and the Applicant’s counsel’s submissions. Those letters explain that the change in proposed work hours was to accommodate the female Prospective Employer’s intention to return to school.\n[17] Finally, the Officer unreasonably concluded that the Prospective Employers intended to have the Applicant care for their 16-year-old son. This conclusion demonstrates that the Officer misread the Employment Offer, job description, and the Prospective Employer’s letter. This evidence makes it clear that the Prospective Employers’ intent is for the Applicant to care for their younger child.\n[18] With respect to the Prospective Employers’ ability to fulfil the terms of the Employment Offer, the Officer erred in determining that $65,000 “is not a reasonable salary at which to live in order to have a caregiver when compared to the benefits of having an additional $30,000.” The Applicant submits that the Officer departed from the established method for assessing financial sufficiency and adopted a methodology “without any apparent or known rules.”\n(2) Respondent’s Position\n[19] The Officer’s error with respect to the date of the female Prospective Employer’s job offer is inconsequential. One written job offer supports the Officer’s finding that there was insufficient evidence that the female Prospective Employer had turned down employment due to a lack of childcare.\n[20] The Respondent submits that Legal Counsel’s Letter, which provided an explanation for the reduction in the Applicant’s work hours, is not evidence. This letter required corroboration. Therefore, it was reasonable for the Officer to conclude that the Prospective Employers did not provide a clear reason for the reduction in hours.\n[21] The Officer did not err by stating that the Prospective Employers intended to have the Applicant care for both of their children. The Respondent notes the use of the word “children” in both the Application and the Employment Offer. The Respondent says the Officer was under no obligation to clarify this ambiguity for the Applicant.\n[22] Finally, the Officer’s assessment of the Prospective Employers’ financial situation, viewed in the broader context, was reasonable.\n(3) Analysis\n[23] In Aghaalikhani v Canada (Citizenship and Immigration), 2019 FC 1080 at para 24, Justice Gascon held that “when an administrative tribunal is silent on evidence clearly pointing to an opposite conclusion and squarely contradicting its findings of fact, the Court may intervene and infer that the tribunal overlooked the contradictory evidence when making its decision.” Justice Gascon also held that when parts of the evidence are “misapprehended” and “where the findings do not flow from the evidence” the decision will not be reasonable (at para 17). Likewise, more recently, in Vavilov the Supreme Court of Canada stated:\n[126] That being said, a reasonable decision is one that is justified in light of the facts: Dunsmuir, para. 47. The decision maker must take the evidentiary record and the general factual matrix that bears on its decision into account, and its decision must be reasonable in light of them: see Southam, at para. 56. The reasonableness of a decision may be jeopardized where the decision maker has fundamentally misapprehended or failed to account for the evidence before it.\n[24] I am persuaded by the Applicant’s submissions that the Officer overlooked or misapprehended material evidence, rendering the Decision unreasonable. First, the Officer fails to mention the Prospective Employers’ evidence that further job offers were not adduced because they were made orally. The Officer simply declares that “it is unclear why those earlier offers were not provided.”\n[25] The Officer also incorrectly cites the date on the female Prospective Employer’s job offer by one year. This mistake leads the Officer to infer that her job search began only after the Officer requested evidence of job offers. Based on this misapprehension of evidence, the Officer gives little weight to the female employer’s prospects of future employment, which is the primary reason for the Officer’s concerns about the Prospective Employers’ reasonable needs.\n[26] The Officer relies on this misapprehension when concluding that it is “unreasonable” for the female Prospective Employer to refuse work “given the number of families in Canada where both parents work without a caregiver.” There is no basis for this conclusion. This statement also indicates that the Officer overlooked the evidence of the male Prospective Employers extensive travel for work. Ultimately, I find the Officer’s findings related to the female Prospective Employer’s job situation unreasonable.\n[27] Furthermore, I find the Officer’s conclusion about the Prospective Employers’ ability to fulfil the terms of the Employment Offer speculative and not based on the evidence. The Officer failed to explain why the Prospective Employer’s ability to pay the Applicant was insufficient. The Officer makes no mention of the Prospective Employer’s savings nor explains why an income well above the Low Income Cut Off leads to concerns that the Prospective Employers cannot reasonably fulfill the Employment Offer. The reasons do not permit the Court to understand how the Officer arrived at this finding.\n[28] The Officer also expresses concern that the Prospective Employers could not reasonably fulfill the terms of the Applicant’s Employment Offer because they reduced the work hours in the updated contract by one hour per day. The Officer speculates that if the Prospective Employers’ needs increase to eight hours per day, the “financial arrangement would be even less reasonable.” While I am not convinced by the Applicant’s submissions that the change was “completely explained” by the Prospective Employer’s letter, the Officer nevertheless bases his finding on his assessment that $65,000 is not enough to live off. The Officer’s adverse inference concerning the updated employment hours flows from the flawed financial sufficiency analysis. The “assessment of the employer’s capacity to pay should not be based on speculation” (Bautista v Canada, 2018 FC 669 at para 16).\n[29] Finally, the Officer makes a number of errors regarding what child the Applicant would care for. The Officer erroneously states that the Prospective Employers “have indicated they want the Applicant to supervise the 16 year old to keep him out of trouble.” In their July 14, 2019 letter, the Prospective Employers explain that their “intention” is to hire a caregiver to care for the younger child. This would allow the female Prospective Employer to focus more of her attention on her 16-year-old son to ensure he does not “take the wrong path with peer group and pressure.” Furthermore, the Employment Offer only lists the younger child as the child in need of care. Finally, I note that the Officer questions why “a new caregiver would have more success” “if a teenager is disobedient to their parents.” This statement is also speculative and not based on the contents of the Application.\n[30] Ultimately, I find that the Decision is based on overlooked or misapprehended evidence. The Decision is not justified, transparent, and intelligible. Therefore, it is not reasonable.\nB. Should the Court enter an indirect substitution or make a cost order in favour of the Applicant?\n(1) Applicant’s Position\n[31] The Applicant requests a “directed verdict” on the ground that all factual findings have been made. The Applicant states that the Court can make a decision “without wading into the decision-making process on the basis of an incomplete factual record” and without weighing the evidence “in place of the decision-maker.” The Respondent has not submitted contrary evidence and therefore, the Court is not being asked to weigh evidence. The Applicant points to paragraph 142 of Vavilov where the Supreme Court of Canada stated:\n…An intention that the administrative decision maker decide the matter at first instance cannot give rise to an endless merry-go-round of judicial reviews and subsequent reconsiderations. Declining to remit a matter to the decision maker may be appropriate where it becomes evident to the court, in the course of its review, that a particular outcome is inevitable and that remitting the case would therefore serve no useful purpose.\n[32] It has been more than a year since the Applicant applied for her work permit. The Applicant submits that allowing a “directed verdict” will spare her from another lengthy delay.\n(2) Respondent’s Position\n[33] The Respondent submits that this is not an appropriate case for indirect substitution – the correct term for “directed verdict” in the administrative context – because, contrary to what the Applicant submits, “there is not only one lawful response, or one reasonable conclusion.” The Respondent also submits that this is not an appropriate case for a costs award because “[t]here is no evidence that the Respondent has unnecessarily or unreasonably prolonged the proceedings.”\n(3) Analysis\n[34] In Canada (Citizenship and Immigration) v Tennant, 2019 FCA 206, the Federal Court of Appeal [FCA] determined that the remedy of indirect substitution is an exceptional power under the law of judicial review (at para 79). It is available in cases where “the court concludes that there is only one reasonable outcome, so that returning the matter to the administrative decision-maker would be pointless” (at para 82).\n[35] I agree with the Respondent that this is not an exceptional case warranting indirect substitution. Although I have concluded that the Officer overlooked or misapprehended the evidence, this does not lead to the conclusion that there is “only one reasonable outcome.”\n[36] Rule 22 of the Federal Courts Citizenship, Immigration and Refugee Protection Rules, SOR/93-22 [Rules], provides that no costs shall be awarded in respect of an application for judicial review unless the Court, for special reason, so orders. The Rules do not define “special reasons.” At paragraph 7 of Ndungu v Canada (Citizenship and Immigration), 2011 FCA 208 [Ndungu] the FCA summarized the non-exhaustive circumstances in which special reasons will be found to justify an award of costs as well as situations that fall short of the “special reasons” standard. In Sisay Teka v Canada (Immigration, Refugees and Citizenship), 2018 FC 314, this Court held that the special reasons exception contemplated in Rule 22 is a “high bar” (at para 41).\n[37] The Applicant submits that the Respondent has unnecessarily or unreasonably prolonged the proceedings and that this constitutes special reasons (Ndererehe v Canada (Citizenship and Immigration), 2007 FC 880 [Ndererehe]). Ndererehe is distinguishable from the present case. In that case, unlike here, the prolonging of the proceedings led to the Applicants facing risk to their personal safety. Additionally, in Ndererehe the Court found that the Applicant’s situation was oppressive and threatening and that they had suffered since their application was refused (at para 23). Again, no such circumstances are present here.\n[38] In Ndungu, the FCA made clear that an award of costs cannot be justified merely because “an immigration official has made an erroneous decision” (at para 7). In my view, this case does not meet the high bar for a costs award.\nVII. Conclusion\n[39] The Decision is not reasonable. It lacks the requisite degree of transparency, intelligibility, and justification. The application for judicial review is allowed.\n[40] This is not an appropriate case for the Court to enter an indirect substitution or to award costs.\n[41] The parties did not raise any question of general importance for certification and none arises.\nJUDGMENT in IMM-6744-19\nTHIS COURT’S JUDGMENT is that:\nThe application for judicial review allowed.\nThere is no question for certification.\nThere is no order as to costs.\n\"Paul Favel\"\nJudge\nFEDERAL COURT\nSOLICITORS OF RECORD\nDocket:\nIMM-6744-19\nSTYLE OF CAUSE:\nRESHMA ANITHA D SOUZA v THE MINISTER OF CITZENSHIP AND IMMIGRATION\nPLACE OF HEARING:\nHELD BY VIDEOCONFERENCE\nDATE OF HEARING:\njune 2, 2021\nJUDGMENT AND reasons:\nFAVEL J.\nDATED:\ndecember 16, 2021\nAPPEARANCES:\nDeanna Okun-Nachoff\nFor The Applicant\nJulio Paoletti\nFor The Respondent\nSOLICITORS OF RECORD:\nDeanna Okun-Nachoff\nMcCrea Immigration Law\nVancouver, B.C.\nFor The Applicant\nJulio Paoletti\nAttorney General of Canada\nVancouver, B.C.\nFor The Respondent\n",
"cluster: CONCLUSION: The court allows the application for judicial review and sets aside the decision of the visa officer. The court declines to enter an indirect substitution or make a cost order in favour of the person concerned, as it does not meet the high bar for a costs award. The court finds that the decision was not reasonable, and the person concerned's application for a temporary resident visa and work permit should be reconsidered.",
"cluster: SUMMARY: **(1) Facts**\n\nThe person concerned, a citizen of India, applied for a temporary resident visa and work permit to work as an in-home child caregiver in Calgary, Alberta. Her application was based on a positive Labour Market Impact Assessment issued to her prospective employers, a couple with two children. The couple signed a two-year employment contract with the person concerned, which they later amended to reflect slightly less hours of work. The person concerned's application was initially refused, and she applied for leave and judicial review. The case was re-determined by a different officer, who requested further information from the couple. The person concerned's legal counsel submitted additional documents, including a written employment offer and updated Notices of Assessment. Despite this, the officer refused the application, concluding that the employment offer was not genuine.\n\n**(2) Issue**\n\nThe main issue before the court is whether the decision of the visa officer to refuse the person concerned's application for a temporary resident visa and work permit was reasonable. The court also considers whether it should enter an indirect substitution or make a cost order in favour of the person concerned.\n\n**(3) Rule**\n\nThe court applies the standard of review of reasonableness, as set out in Canada (Minister of Citizenship and Immigration) v Vavilov, 2019 SCC 65. The court must consider both the outcome and the underlying rationale of the decision to assess whether it is transparent, intelligible, and justified.\n\n**(4) Analysis**\n\nThe court finds that the decision of the visa officer was not reasonable. The officer overlooked or misapprehended material evidence, including the couple's explanation for the reduction in work hours and the female employer's prospects of future employment. The officer also made several errors regarding the couple's ability to fulfill the terms of the employment offer, including their financial situation and the number of hours they would need to hire a caregiver. The court finds that the officer's findings were speculative and not based on the evidence.\n\nThe court also finds that the decision is not justified, transparent, and intelligible. The officer's conclusion that the employment offer was not genuine is not supported by the evidence, and the officer failed to consider the couple's explanations and submissions.\n\n**(5) Conclusion**\n\nThe court allows the application for judicial review and sets aside the decision of the visa officer. The court declines to enter an indirect substitution or make a cost order in favour of the person concerned, as it does not meet the high bar for a costs award. The court finds that the decision was not reasonable, and the person concerned's application for a temporary resident visa and work permit should be reconsidered.",
"cluster: SUMMARY: **(1) Facts**\nThe person concerned, a visa applicant, sought judicial review of a decision made by the Visa Officer, who was acting on behalf of the Minister of Citizenship and Immigration. The Visa Officer had refused to issue a visa to the applicant due to concerns about his adaptability for personal suitability purposes. Specifically, the Visa Officer had questioned the applicant's lack of travelling experience. The applicant had not provided any evidence to counter the Visa Officer's concerns, and the officer had not informed the applicant of her assessment of his evidence during the interview. The applicant's counsel argued that the Visa Officer had taken into account an irrelevant consideration and that the applicant had not been given an opportunity to respond to the officer's concerns.\n\n**(2) Issue**\nThe issue before the court was whether the Visa Officer had erred in refusing to issue a visa to the applicant due to his lack of travelling experience. The court had to determine whether the officer's consideration of this factor was relevant and whether the applicant had been given adequate opportunity to respond to the officer's concerns.\n\n**(3) Rule**\nThe court applied the relevant rules and principles of administrative law, including the duty of a decision-maker to consider relevant factors and to provide adequate reasons for their decisions. The court also considered the principle that a decision-maker is not required to inform an applicant of their assessment of their evidence during an interview.\n\n**(4) Analysis**\nIn analyzing the issue, the court noted that the applicant's lack of travelling experience may be relevant to the question of his adaptability for personal suitability purposes. The court also noted that there was no indication that undue emphasis was placed on this consideration by the Visa Officer. Furthermore, the court held that the applicant had not been denied an opportunity to respond to the officer's concerns, as the officer had not been required to inform the applicant of her assessment of his evidence during the interview. The court concluded that the Visa Officer had not erred in refusing to issue a visa to the applicant.\n\n**(5) Conclusion**\nThe judicial review was dismissed, and the decision of the Visa Officer was upheld. The court found that the Visa Officer had not taken into account an irrelevant consideration and that the applicant had been given adequate opportunity to respond to the officer's concerns. The court's decision was based on the principles of administrative law and the relevant rules governing the decision-making process of the Visa Officer."
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]This is a sentence-transformers model finetuned from nomic-ai/nomic-embed-text-v1.5. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
SentenceTransformer(
(0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: NomicBertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("simonosgoode/nomic_embed_fine_tune_law_1.5")
# Run inference
sentences = [
'cluster: CONCLUSION: Bacon St-Onge v. Conseil des Innus de Pessamit\nCourt (s) Database\nFederal Court Decisions\nDate\n2018-06-22\nNeutral citation\n2018 FC 655\nFile numbers\nT-2135-16\nDecision Content\nDate: 20180622\nDocket: T-2135-16\nCitation: 2018 FC 655\n[ENGLISH TRANSLATION]\nMontréal, Quebec, June 22, 2018\nPRESENT: The Honourable Madam Justice St-Louis\nBETWEEN:\nJÉRÔME BACON ST-ONGE\nApplicant\nand\nLE CONSEIL DES INNUS DE PESSAMIT\nRENÉ SIMON\nÉRIC CANAPÉ\nGÉRALD HERVIEUX\nDIANE RIVERIN\nJEAN-NOËL RIVERIN\nRAYMOND ROUSSELOT\nMARIELLE VACHON\nRespondents\nORDER AND REASONS\nI. Background\n[1] On December 21, 2017, the Court upheld the application for judicial review submitted by the Applicant, Jérôme Bacon St-Onge and, in particular, revoked the resolution adopted by the band council on March 8, 2016, adjudged the 2015 Code to be invalid, and voided the election held on August 17, 2016. The Court then asked the parties to make submissions concerning costs.\n[2] On January 22, 2018, the Respondents filed an appeal of this judgment with the Federal Court of Appeal [FCA]. At the same time, they also filed a motion to stay the execution of said judgment (docket A-42-18), a motion that FCA dismissed on April 23, 2018.\n[3] On February 6, 2018, the Applicant made his submissions concerning costs. He included an affidavit from Mr. Boulianne and filed Exhibit 1, which included three invoices and two statements of account from the firm of Neashish & Champoux s.e.n.c., indicating that he had been invoiced an amount totalling $82,544.35. On March 23, 2018, the Respondents submitted their representations concerning costs. They attached three items: the order from Prothonotary Morneau refusing the application for the Applicant’s interim costs, news articles, and the notice of appeal of the aforementioned decision dated December 21, 2017. Finally, on April 4, 2018, the Applicant submitted his response concerning costs.\n[4] The parties did not submit a bill of costs and hence the Court does not know the estimated amount of costs that would be granted according to Column III of Tariff B, if Rule 407 of the Federal Courts Rules, SOR/98-106 [the Rules] were applied.\nII. Position of the parties\n[5] Mr. Bacon St-Onge is requesting payment of costs on the attorney-client basis, thus covering all of the professional and legal fees incurred. In support of this request, he basically presented five (5) arguments, namely (1) his application for judicial review was upheld; (2) the application was brought in the public’s interest and it went beyond the scope of his individual interests; (3) unlike the Respondents, he is not in a position to have the First Nation reimburse the legal fees; (4) the case required a considerable amount of work because the facts and applicable law were complex and because the cases consisted of more than 2,000 pages; and (5) the Respondents unjustifiably refused to withdraw from a proceeding that was condemned in advance.\n[6] Mr. Bacon St-Onge also asked the Court (1) to reserve his right to again apply to a court of competent jurisdiction to claim any order and any additional sum required with respect to costs for the Respondents’ application for review; and (2) to exempt him from all the fees and expenses to be paid to the Respondents as part of this claim, the principal claim and any other ancillary or incidental claim in this case and in the appeal case.\n[7] To begin with, the Court confirms that it will not decide on these last two claims related either to possible future cases or to the appeal proceedings. Thus, this decision will be limited to the application for costs related to the litigation settled by the judgment delivered last December 21.\n[8] The Respondents reply that the expenses cannot be granted to the Applicant basically because (1) Prothonotary Morneau had refused the Applicant’s request for interim costs and there is thus res judicata on the question of expenses; and (2) the appeal dated December 21, 2017, suspends the awarding of costs and said costs will only be payable by the Applicant if their appeal is dismissed.\n[9] The Respondents add that, should costs be granted, (1) they must be calculated according to Column III of Tariff B of the Rules; (2) the questions raised in this case are not of concern to Band members, do not fall outside the individual interests of the Applicant, who showed interest in standing for election, thus showing that he had an individual interest in voiding the elections; (3) the Applicant unreasonably delayed bringing his complaint and the voters and candidates were greatly inconvenienced by the election’s invalidity; (4) the invoices that the Applicant submitted in support of his application for costs do not provide the dates and hours worked in the case and have no probative value, being domestic writings; and (5) the questions to be decided are not particularly complicated.\n[10] The Applicant replies that Prothonotary Morneau’s order decided on the application for interim costs, proceedings separate from the awarding of costs. The criteria that underlie the awarding of costs are different and, therefore, there is no res judicata in this case. Finally, the Applicant points out that he had no choice other than to turn to the courts because the Respondents refused to consider the Band members’ remarks concerning the illegality of the process for amending the 1994 Code. He thus acted for the good of all Band members. In response to the arguments concerning the format of the invoices submitted, he maintains that they are unsigned writings used in the course of business activities and that they are thus proof of their content.\n[11] Finally, the Applicant maintains that costs can be granted even if the decision is under appeal (Martselos v. Salt River Nation #195, 2008 FCA 221 at paragraphs 51 to 55).\nIII. Discussion\n[12] We should first deal with two of the arguments raised by the Respondents: the one related to the thing adjudicated and the one related to the effect of the appeal and the stay motion that were lodged.\n[13] Thus, the Court agrees with the Applicant’s position and concludes that Prothonotary Morneau’s decision on the interim costs is not res judicata on the awarding of costs at the end of the litigation. At least one of the three criteria established in Angle v. M.N.R., [1975] 2 SCR 248, the one requiring that the same question has been decided, is not satisfied here. The criteria related to a decision on the application for interim costs are different from those considered within the framework of the awarding of costs, and thus it cannot have res judicata.\n[14] As for the effect of the stay motion and the appeal that the Respondents presented to FCA, the Court notes that the Respondents did not submit any case law to support their argument. First, FCA dismissed the stay motion, and thus it is not necessary to focus on its implications with respect to the awarding of costs. Next, our Court has already agreed that appealing a Federal Court decision does not prevent the taxation of costs in the first instance (Halford v. Seed Hawk Inc., 2004 FC 1259 at paragraph 36). Thus, the Court has not been convinced that the appeal of the decision dated December 21, 2017, suspends the awarding of costs.\n[15] The Court will therefore decide on the awarding of costs and, in this regard, the Court is convinced that here, the costs must be granted in favour of the Applicant because his application for judicial review was upheld (Ticketnet Corp v. The Queen, [1999] FCA No. 1102, 99 DTC 5429).\n[16] The awarding of costs between parties is set out in sections 400 to 414 of Part II of Rules. To award costs, courts try to establish a fair balance between three principal objectives, namely “providing compensation, promoting settlement and deterring abusive behaviour” (Air Canada v. Thibodeau, 2007 FCA 115 at paragraph 24). Thus, according to Rule 407, unless the Court orders otherwise, the costs between parties are taxed in compliance with Column III of Tariff Table B.\n[17] As well, subsection 400(1) of the Rules states that the Court “shall have full discretionary power over the amount and allocation of costs and the determination of by whom they are to be paid.” The Court’s vast discretionary power over the awarding of costs has only two exceptions, related to representative actions and immigration cases, which are not at issue in this case.\n[18] Otherwise, the Court enjoys vast discretionary power (Salt River Nation #195 v. Martselos, 2008 FCA 221 at paragraphs 52 and 53). The factors that the Court may take into account are stated in subsection 400(3) of the Rules, the text of which is annexed. They include some of the factors raised by the Applicant, such as the importance and complexity of the issues (400(3)(c)), the amount of work (400(3)(g)) and whether the public interest in having the proceeding litigated justifies a particular award of costs (400(3)(h)).\n[19] The Court has the power to award a gross sum or to issue a more general order (Consorzio del Prosciutto di Parma v. Maple Leaf Meats Inc. (CA), 2002 FCA 417 at paragraphs 8 to 10).\n[20] The Court must therefore decide whether the costs will be assessed through taxation or by the awarding of a gross sum and must also decide whether there is cause to award a specific, higher amount either on the attorney-client basis or on the basis of the public interest.\n[21] To begin with, the Court rules out the payment of costs on the attorney-client basis because nothing in the case indicates that the Respondents demonstrated “reprehensible, scandalous or outrageous conduct” (Young v. Young, [1993] 4 SCR 3 at p. 134; Quebec (Attorney General) v. Lacombe, 2010 SCC 38 at paragraph 67).\n[22] As for a specific amount on the basis of public interest, the Supreme Court established, in the Carter decision (Carter v. Canada (Attorney General), 2015 SCC 5 at paragraph 140), a two-component criterion for awarding special costs to a successful party representing the public interest:\n. . . First, the case must involve matters of public interest that are truly exceptional. It is not enough that the issues raised have not previously been resolved or that they transcend the individual interests of the successful litigant: they must also have a significant and widespread societal impact. Second, in addition to showing that they have no personal, proprietary or pecuniary interest in the litigation that would justify the proceedings on economic grounds, the plaintiffs must show that it would not have been possible to effectively pursue the litigation in question with private funding. In those rare cases, it will be contrary to the interests of justice to ask the individual litigants (or, more likely, pro bono counsel) to bear the majority of the financial burden associated with pursuing the claim.\n[23] In this case, the Court notes that determining the electoral code’s validity is as much an interest for the Band as it is for the Applicant because the latter was a candidate in the elections whose cancellation he requested. Thus the Applicant cannot maintain that he had no individual interest in the litigation and here, at least one of the Supreme Court’s aforementioned criteria has not been satisfied.\n[24] In addition, it seems fair to argue that the Applicant is not in a position to get the Band to reimburse him for his legal fees. The Respondents have not submitted evidence showing that they paid their legal fees (Bellegarde v. Poitras, 2009 FC 1212 at paragraph 8) and it seems plausible to find that they are not paying them themselves, since they are members of the Band council.\n[25] Finally, the Court can find only that the workload and the complexity of the case or that the behaviour of the Respondents, having continued the proceedings, in themselves justify the awarding of special costs.\n[26] Hence, because the electoral code’s validity is effectively also a question of interest for the Band and because the Applicant is solely responsible for the litigation costs, the Court is convinced that the situation is an argument for awarding costs higher than those in Column III of Tariff B. In the absence of the parties’ bill of costs, the Court finds it difficult to set a “higher” amount by gross sum. Therefore, the Court will instead grant the Applicant costs through taxation, according to the upper band of Column V of Tariff B.\nJUDGMENT in file T-2135-16\nTHIS COURT’S JUDGMENT is that:\nThe Respondents are to pay costs to the Applicant according to the upper band of Column V of Tariff B;\n“Martine St-Louis”\nJudge\nRule 400(3)\nFactors in awarding costs\n(3) In exercising its discretion under subsection (1), the Court may consider\n(a) the result of the proceeding;\n(b) the amounts claimed and the amounts recovered;\n(c) the importance and complexity of the issues;\n(d) the apportionment of liability;\n(e) any written offer to settle;\n(f) any offer to contribute made under rule 421;\n(g) the amount of work;\n(h) whether the public interest in having the proceeding litigated justifies a particular award of costs;\n(i) any conduct of a party that tended to shorten or unnecessarily lengthen the duration of the proceeding;\n(j) the failure by a party to admit anything that should have been admitted or to serve a request to admit;\n(k) whether any step in the proceeding was\n(i) improper, vexatious or unnecessary, or\n(ii) taken through negligence, mistake or excessive caution;\n(l) whether more than one set of costs should be allowed, where two or more parties were represented by different solicitors or were represented by the same solicitor but separated their defence unnecessarily;\n(m) whether two or more parties, represented by the same solicitor, initiated separate proceedings unnecessarily;\n(n) whether a party who was successful in an action exaggerated a claim, including a counterclaim or third party claim, to avoid the operation of rules 292 to 299;\n(n.1) whether the expense required to have an expert witness give evidence was justified given\n(i) the nature of the litigation, its public significance and any need to clarify the law,\n(ii) the number, complexity or technical nature of the issues in dispute, or\n(iii) the amount in dispute in the proceeding; and\n(o) any other matter that it considers relevant.\nRègle 400(3)\nFacteurs à prendre en compte\n(3) Dans l’exercice de son pouvoir discrétionnaire en application du paragraphe (1), la Cour peut tenir compte de l’un ou l’autre des facteurs suivants :\na) le résultat de l’instance;\nb) les sommes réclamées et les sommes recouvrées;\nc) l’importance et la complexité des questions en litige;\nd) le partage de la responsabilité;\ne) toute offre écrite de règlement;\nf) toute offre de contribution faite en vertu de la règle 421;\ng) la charge de travail;\nh) le fait que l’intérêt public dans la résolution judiciaire de l’instance justifie une adjudication particulière des dépens;\ni) la conduite d’une partie qui a eu pour effet d’abréger ou de prolonger inutilement la durée de l’instance;\nj) le défaut de la part d’une partie de signifier une demande visée à la règle 255 ou de reconnaître ce qui aurait dû être admis;\nk) la question de savoir si une mesure prise au cours de l’instance, selon le cas :\n(i) était inappropriée, vexatoire ou inutile,\n(ii) a été entreprise de manière négligente, par erreur ou avec trop de circonspection;\nl) la question de savoir si plus d’un mémoire de dépens devrait être accordé lorsque deux ou plusieurs parties sont représentées par différents avocats ou lorsque, étant représentées par le même avocat, elles ont scindé inutilement leur défense;\nm) la question de savoir si deux ou plusieurs parties représentées par le même avocat ont engagé inutilement des instances distinctes;\nn) la question de savoir si la partie qui a eu gain de cause dans une action a exagéré le montant de sa réclamation, notamment celle indiquée dans la demande reconventionnelle ou la mise en cause, pour éviter l’application des règles 292 à 299;\nn.1) la question de savoir si les dépenses engagées pour la déposition d’un témoin expert étaient justifiées compte tenu de l’un ou l’autre des facteurs suivants :\n(i) la nature du litige, son importance pour le public et la nécessité de clarifier le droit,\n(ii) le nombre, la complexité ou la nature technique des questions en litige,\n(iii) la somme en litige;\no) toute autre question qu’elle juge pertinente.\nFEDERAL COURT\nSOLICITORS OF RECORD\nDOCKET:\nT-2135-16\nSTYLE OF CAUSE:\nJÉRÔME BACON ST-ONGE v. THE CONSEIL DES INNUS DE PESSAMIT, RENÉ SIMON, ÉRIC CANAPÉ, GÉRALD HERVIEUX, DIANE RIVERIN, JEAN-NOEL RIVERIN, RAYMON ROUSSELOT, MARIELLE VACHON\nREASONS FOR ORDER AND ORDER:\nST-LOUIS J.\nDATED:\nJune 22, 2018\nWRITTEN SUBMISSIONS BY:\nFrançois Boulianne\nFOR THE APPLICANT\nKenneth Gauthier\nFor the respondents\nSOLICITORS OF RECORD:\nNeashish & Champoux, s.e.n.c.\nWendake, Quebec\nFOR THE APPLICANT\nKenneth Gauthier\nCounsel\nBaie-Comeau, Quebec\nFor the respondents\n',
"cluster: CONCLUSION: The Court concluded that the Respondents were to pay costs to the Applicant according to the upper band of Column V of Tariff B. The Court's decision was based on its discretionary power to award costs, taking into account the factors set out in Rule 400(3) of the Federal Courts Rules. The Court's decision was intended to provide a fair balance between the parties and to reflect the complexity and importance of the issues in the case.",
"cluster: ANALYSIS: The Court analyzed the factors to be considered in awarding costs, as set out in Rule 400(3) of the Federal Courts Rules. The Court considered the importance and complexity of the issues, the amount of work, and the public interest in having the proceeding litigated. The Court also considered the conduct of the parties, including the Respondents' refusal to consider the Band members' remarks concerning the illegality of the process for amending the 1994 Code. The Court found that the Applicant was solely responsible for the litigation costs and that the situation justified awarding costs higher than those in Column III of Tariff B. However, the Court did not find that the case met the two-component criterion for awarding special costs to a successful party representing the public interest, as established by the Supreme Court in the Carter decision.",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
anchor, positive, and negative| anchor | positive | negative | |
|---|---|---|---|
| type | string | string | string |
| details |
|
|
|
| anchor | positive | negative |
|---|---|---|
cluster: ANALYSIS: Jalota v. Canada (Citizenship and Immigration) |
cluster: ANALYSIS: The court analyzed the case by considering the principles of natural justice and procedural fairness. The court held that a breach of natural justice in decision-making is an error of law and jurisdiction that results in the whole decision being quashed, unless there are exceptional circumstances where the breach could not have affected the result. In this case, the breach of procedural fairness was not limited to the failure to request prior transcripts but was also evident in the unclear decision-making process and the officer's reliance on new-found grounds.The court also examined the Document Checklist – Student issued by Citizenship and Immigration Canada and found that it did not ask for financial information per se as part of a restoration application. The key requirement for restoration applications was the production of documents related to the loss of status. The court concluded that the officer's failure to request financial information was a breach of procedural fairness, particularly since the person concerned had confirmed his financial situation and offered to provide evidence if required. |
cluster: SUMMARY: (1) Facts |
cluster: ISSUES: Melo Castrillon v. Canada (Citizenship and Immigration) |
cluster: ISSUES: The person concerned sought judicial review of the RPD's decision, arguing that she had lost her permanent resident status in Italy after being absent for 12 consecutive months. The issue before the court was whether the RPD's decision that the person concerned had permanent resident status on June 23, 2016, was reasonable. |
cluster: SUMMARY: (1) Facts |
cluster: FACTS: Bell Canada v. Lackman |
cluster: FACTS: This case involves a dispute between the plaintiffs, a group of Canadian broadcasters and broadcasting undertakings, and the defendant, a software developer, Adam Lackman. The plaintiffs alleged that the defendant's software, known as TVAddons, allowed users to access copyrighted content without permission. The defendant claimed that his software was compliant with the Copyright Act and that he was not communicating any content, but rather making it accessible like a search engine. The plaintiffs sought an Anton Piller order, which is a civil search warrant that allows a plaintiff to search the defendant's premises without notice, to seize evidence and preserve it. The order was granted by a justice of the Federal Court, but the defendant challenged it on a review motion. |
cluster: ANALYSIS: The court's analysis was based on the principles established in the leading case of Celanese Canada Inc. v. Murray Demolition Corporation, which sets out the conditions necessary for the issuance of an Anton Piller order. The court found that the plaintiffs had failed to meet these conditions, particularly with respect to the prima facie case and the scope of the order. The court also considered the defendant's argument that his software was compliant with the Copyright Act and that he was not communicating any content, but rather making it accessible like a search engine. The court found that this argument had merit and that the plaintiffs had not met the requirements for an interlocutory injunction. |
MultipleNegativesRankingLoss with these parameters:{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
anchor, positive, and negative| anchor | positive | negative | |
|---|---|---|---|
| type | string | string | string |
| details |
|
|
|
| anchor | positive | negative |
|---|---|---|
cluster: FACTS: Murphy v. Canada (Attorney General) |
cluster: FACTS: The person concerned, a 58-year-old woman from Gander, Newfoundland, applied for Canada Pension Plan (CPP) disability benefits. She had a significant speech impairment and was unable to work due to a stroke she suffered in 2011 and a knee injury she sustained in 2009. She had a limited education and work experience, with only a few short-term jobs between 1979 and 2011. Her application was initially denied in 2011 and again in 2012 after reconsideration. She appealed the decision to the Social Security Tribunal – General Division (SST-GD), which conducted a paper appeal and denied her application in 2015. The SST-GD found that she failed to prove that she had a severe and prolonged disability on or before December 31, 1997, the minimum qualifying period (MQP) for CPP disability benefits. The person concerned then sought leave to appeal to the Social Security Tribunal – Appeal Division (SST-AD), which denied her application in 2015. She subsequently applied for judicial review of the SST-AD's decision. |
cluster: CONCLUSION: In conclusion, the court's decision in this case was based on the principle that the SST must interpret and apply the CPP Act in a liberal and generous manner. The court found that the SST-GD and SST-AD had failed to apply this principle in the person concerned's case, and that their decisions were therefore unreasonable. The court's decision was also based on the principle that the person concerned had a right to a more comprehensive disability review that considers her employability in the real world. The court's conclusion was that the SST-AD's decision was not reasonable and that the matter should be remitted to a differently constituted SST-AD for redetermination. |
cluster: CONCLUSION: Altamirano v. Canada (Citizenship and Immigration) |
cluster: CONCLUSION: The court concluded that the RAD's decision is reasonable in light of the Applicants' circumstances and evidence. The application for judicial review is therefore dismissed. |
cluster: SUMMARY: (1) Facts |
cluster: CONCLUSION: Osipova v. Canada (Citizenship and Immigration) |
cluster: CONCLUSION: The court allowed the application for judicial review, set aside the decision, and remitted the matter back to a different officer for redetermination. Prior to the redetermination, the person concerned would be given an opportunity to provide updated submissions and documentation in support of her application. The court found that the Officer's BIOC analysis was unreasonable, which rendered the decision as a whole unreasonable, and that the person concerned had raised sufficient grounds for judicial review. |
cluster: ISSUES: The sole issue before the court was whether the Officer's decision was reasonable. The person concerned argued that the Officer's decision was unreasonable due to several factors, including a failure to conduct a proper assessment of hardship, an error in assessing the best interests of the child, and a failure to give proper consideration to adverse country conditions in Russia. |
MultipleNegativesRankingLoss with these parameters:{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
eval_strategy: stepsper_device_train_batch_size: 4per_device_eval_batch_size: 4learning_rate: 2e-05num_train_epochs: 1warmup_ratio: 0.1fp16: Truebatch_sampler: no_duplicatesoverwrite_output_dir: Falsedo_predict: Falseeval_strategy: stepsprediction_loss_only: Trueper_device_train_batch_size: 4per_device_eval_batch_size: 4per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 1max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Falsefp16: Truefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torchoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Falsehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseeval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters: auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseeval_use_gather_object: Falsebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportional| Epoch | Step | Training Loss | loss |
|---|---|---|---|
| 0.0296 | 100 | 0.7554 | 0.0647 |
| 0.0593 | 200 | 0.0222 | 0.0314 |
| 0.0889 | 300 | 0.0359 | 0.0220 |
| 0.1185 | 400 | 0.0189 | 0.0175 |
| 0.1481 | 500 | 0.024 | 0.0145 |
| 0.1778 | 600 | 0.0164 | 0.0112 |
| 0.2074 | 700 | 0.0337 | 0.0139 |
| 0.2370 | 800 | 0.0141 | 0.0092 |
| 0.2667 | 900 | 0.0088 | 0.0106 |
| 0.2963 | 1000 | 0.0093 | 0.0106 |
| 0.3259 | 1100 | 0.0217 | 0.0111 |
| 0.3556 | 1200 | 0.0063 | 0.0095 |
| 0.3852 | 1300 | 0.0188 | 0.0116 |
| 0.4148 | 1400 | 0.0184 | 0.0078 |
| 0.4444 | 1500 | 0.0146 | 0.0084 |
| 0.4741 | 1600 | 0.0035 | 0.0073 |
| 0.5037 | 1700 | 0.0062 | 0.0089 |
| 0.5333 | 1800 | 0.0052 | 0.0058 |
| 0.5630 | 1900 | 0.0035 | 0.0070 |
| 0.5926 | 2000 | 0.0137 | 0.0057 |
| 0.6222 | 2100 | 0.0027 | 0.0056 |
| 0.6519 | 2200 | 0.0066 | 0.0059 |
| 0.6815 | 2300 | 0.0174 | 0.0067 |
| 0.7111 | 2400 | 0.0061 | 0.0054 |
| 0.7407 | 2500 | 0.0046 | 0.0053 |
| 0.7704 | 2600 | 0.002 | 0.0050 |
| 0.8 | 2700 | 0.0086 | 0.0044 |
| 0.8296 | 2800 | 0.008 | 0.0045 |
| 0.8593 | 2900 | 0.0074 | 0.0039 |
| 0.8889 | 3000 | 0.001 | 0.0039 |
| 0.9185 | 3100 | 0.0038 | 0.0038 |
| 0.9481 | 3200 | 0.0073 | 0.0036 |
| 0.9778 | 3300 | 0.0014 | 0.0036 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
Base model
nomic-ai/nomic-embed-text-v1.5